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ABSTRACT 


This thesis discusses and implements an interactive decision support system using 
a Prescriptive Garbage Can Model. The fundamental presumtion is that if the choice- 
outcome relationships in an organization can be observed and evaluated, it is possible 
to extract predictiveness from uncertain streams, and allow the organization to shift to 
a less random strategy. Solving organizational problems consists of selecting those 
choices that lead the organization in a direction towards the ideal state. Thus, it 1s 
convenient to model the organizational state transitions as a Markovian process with 
Stationary properties. The purpose of a Prescriptive Garbage Can Model is to advise 
the participants of the choices available in a current situation, and to present choice 
policies leading the highest potential benefits. Also a method of interfacing the current 


system with an expert system for intelligent deciston making 1s examined. 
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I. INFRODUCTION 


The Prescriptive Garbage Can Model (PGCM) of organizational decision-making 
[Refs. 1.2] can be defined as chance events resulting from the interactionsmareneem 
elements in the organizational context, (1) problems, (11) solutions, (111) participants, and 
(iv) choice opportunities. As with every anarchic and random system, the participants 
desire to solve the current problem in the most effective manner. Which problems are 
actualiy taken up for action, in what prioritv, what choices are made in solviveetiemm 
and how conclusively they are solved. are all functions of ambiguous preferences, and 
time and energy constraints of the participants. 

A model imparting some degree of structure and comprehensibility to the 
complex organizational interactions and suggesting rational choice policies in an 
otherwise irrational context may be of invaluable assistance to organizational decision- 
makers. Thus, the model is prescriptive in nature. The building of such a model would 
link rational decision-making [Refs. 1,3] with anarchic decision-making [Ref 2] 
thought. 

Three objectives of the model are the following : 


1. Advise the participants of the choices available to them in a_ specific 
organizational state 


tm 


Estimate the expected benefit resulting from each choice 


2 


Lay down choice policies which would assist the participants in leading the 
organization in the long run to the state that has the highest potential benefits 


Under severe lack of Knowledge, decision makers mav adopt a random search and 
choice rule, 1e., decisions are ill-defined, inconsistent, unclear, uncertain and 
problematic. Learning and outcomes are a matter of accidental trial-and-error. 

While random strategies are always available. one may wonder whether thev can 
be imbued with conscious thought processes to deal with uncertainty more effectively. 
If the choice-outcome relationships in an organization can be observed and evaluated, 
It is conceivable to extract predictiveness from uncertain streams, and thereby allow the 
organization to shift to a less uncertain strategv, in particular toward cybernetic and 
stochastic decision procedures. 

This study discusses the design and implementation of the Prescriptive Garbage 


Can Model to provide a best course of actions on the anarchic organizational system. 


Chapter II provides background on the prescriptive organizational model of garbage 
can choice policies. This includes a stochastic approach to the garbage can model, 
definitions and assumptions about the components of PGCM, and a prescriptive model 
of organizational choice. Chapter II] examines the decision making process and 
discusses the design and implementation using a military offensive operation example. 
Chapter IV contains reconimendations for further study on the topic. Appendix A is 
the source program. Appendix B is the user manual for the current implementation. 
Appendix C is a demonstration how offensive operation decision choices could be 
taken. Appendix D is a demonstration how university schedule decision choices could 


be taken. 


Il. BACKGROUND 


A. A STOCHASTIC APPROACH TO THE PRESCRIPTIVE GARBAGE CAN 
MODEL 


What appears on the surface as random organizational behavior is most likely 
not totaliv random. but casually influenced by a series of external factors and internal 
choices that can be modelled as probabilistic phenomena. It is often the difficulty of 
understanding numerous organizational and environmental forces that act 
simultaneously which renders probabilistic processes to appear as random occurrences. 
Thus, 1t mav be useful to assume that organizations are ultimately more probabilistic 
in nature than purely random. The probabilistic approach obviously implies an 
inevitable degree of indeterminancv. 

The prescriptive garbage can process, whereby problems, solutions, choices and 
participants are in organizational confluence, is made up of a large number of distinct 
actions sequenced over time. At any point in time, an organization can be 
characterized as belonging to a discrete organizational state. An organizational state 1s 
the conditional wherein essential characteristics of the organization (1.e., state 
variables) take on distinct and measurable values. During the fleeting existence of the 
organization in a specific state, if the participants were seeking globally optimal 
decisions, they would endeavor to identifv the current state of the organization and 
exercise one of the choices that are available to them in that state. However, the effect 
of a decision may not be fully predictable. Thus, while a decision might be attractive 
in terms of an intended effect, an accurate decision calculus may not always be 
possible. Stated thus, organizational flux can be described as consisting of a stream of 
single-step state transitions over time due to the series of decisicns madem Oya. 
participants. In this perspective, stochastic modeling techniques may be applied to 
tame the transition phenomenon [Ref. 1}. 

Despite the probabilistic nature of the organization processes, organizational 
structures are ultimately considered to be homeostatic. This homeostasis concept 
relates to tne capacity of the organization to withstand random perturbations which 
have not been foreseen by the participants [Ref. 1]. According to cyberneticians, an 
organization mav be in any of the enornious number of possible states with related 


choice opportunities. Solving organizational problems consists of selecting those 
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choices that lead the organization in a direction towards the ideal state. Thus, it 1s 
convenient to model the organizational state transitions as a Markovian process with 
stationary properties. A process is stationary when organizational states become stable 
and invariant under time shifts. The homeostatic nature of the organizations implies 


the operation of at least some stationary properties. 


B. DEFINITIONS AND ASSUMPTIONS 
1. Organizational Elements 

As defined in the PGCM. any organization consists of four relatively 
independent elements. Thev are (1) problems, (11) solutions, (1m) participants, and (iv) 
choices. Relative independence implies that each element can assume its own identity, 
existence and relevance. In addition, we presume that problems are triggered by 
external or internal factors and represent the musmatch between the current 
organizational state and the desired state. Solutions are either toois or answers directly 
available within the organization waiting to be bound to the appropriate problems. 
Participants with their limited stocks of energy focus their attention on important 
problems and search for attractive solutions. Choices act as a cementing factor that 


mes the above three elements together. 


2. Organizational States 
The organizational state Z; is a function of three attributes which describe an 


Organization at a certain point in time. These attributes are : 


1. [he importance of the problems remaining to be solved (P;), 


‘9 


The effectiveness of the solutions applied to problems (S,) in the recent past, 


G2 


The energy levels of the participants available for problem-solving (E;). 


The choice of P, S and E as attributes of organizational states 1s motivated by 
the structure of the PGCM which employs these elements as building blocks. P, S and 
E are assumed to be independent and measurable attributes. For convenience of 
fepresentation, we shall use the coordinate system to denote a state. Thus an 
meanizational statenZ. = (P; . S.4E, ). 

3. Choices 
Choices are decisions taken by participants in their pursuit to solve problems. 


They are determined by judging the nature of problems remaining to be solved. the 


effectiveness of the considered solutions, and the energy input available from the 


participants required of a particular choice. In an organized anarchy, choices are 
assumed to be made accidentally. However, if choices were to be made rationally 
ainidst the anarchy, they would presumably carry the organization towards the state 
(O,1,1). Rational managers would prefer such a state because they would like to see as 
many of the remaining important problems solved as possible. in an effective manner, 
and have at their disposal at all times a adequate supply of energy that can be applied 
to future problem solving. This is not to imply that managers wish to remain absorbed 
in state (0,1,1), since this means no opportunities, eternal calculations and unexpended 
energy. Rather, managers would prefer to attain a dynamic equilibrium at or close to 
(O,1.1). At such equilibrium, there is a continuous flow of problem opportunities and 
their effective resolution in a timely fashion so that sufficient manpower energy is 
readilv available to meet new problem opportunities as soon as they arise. 

In general, selecting a choice induces the transition of the organization to a 
new state in the next time interval. It is possible that taking no decisions is a choice in 


itself. It can shift the current state to a new state with more problems. 


4. Choice Policies 

Choice policies provide a prescriptive approach to problem solving. Once a 
set of organizational states and associated choices available therein can be identified, it 
is possible to bring to bear rationality in decision-making by laying down choice 
policies. Choice policies consist of suggestions as to what choices should be preffered 
whiie the organization 1s perceived to be in a particular state. In a sense, choice 
policies form a set of guidelines for organizational decision makers. Usually, the choice 
policies are so recommended as will most likely bring in the maximum benefits for the 


organization in the long run. 


C. A PRESCRIPTIVE MODEL OF ORGANIZATIONAL CHOICE 
i. Organizational Flux as Stochastic Transitions 

introducing rationality into an anarchic system requires that the decision- 
makers observe a calculus cf outcomes based upon the (1) understanding of the 
implications of the various organizational states, (11) knowledge of all the choices 
available to them in each state, and (ill) assessment of the probable impact oF 
exercising a choice on the current state, before they reach a decision. We infuse 
rationality into the Prescriptive Garbage Can Model of anarchic actions through the 


use of a transition probability matrix. 


The transition probability matrix represents the various organizational states, 
the available choices under each state, and the probabilities with which a choice can 


fi eatne Olreamimaioneiromeote Stale t0 another. Z ,i = !...., mn. denotes the 


1 


Organizational states; C; (k), K = f....,m,, the choices available in a state 1; dij 


c(k), the probability that the initial state Z. will transit to Z; when some choice ek) 
is taken. Implicit in the matrix is the fact that there is no guarantee a choice can 
always lead to a state that is predictable beforehand. Impossible states may be filtered 
out from the matrix altogether and infeasible transitions may be represented by Zeros. 
Note that LS c: (Kk) = 1. For simplicity of notation, we omit the subscript i in c; (k), 
and denote by c(k). 

icmp rcsero ce sMlodclsrcouires ste delermmination of the transition 
probabilities. While several methods have appeared in the literature in estimating 
subjective probabilities, one that has evoked considerable interest in recent years 
consists of systematic elicitation of expert judgement [Refs. 1,4,5]. Expert knowledge 
and cpinions often form an adequate surrogate, when historical data seem either 
inapplicable or unavailabie. 

The fellowing steps describe the mechanics of generating the transition 


probability matrix : 


e Step 1: Determination of the set of organizational states, n. 
First, determine the number of possible values p can take. For this divide the 
scale (0,1) into as many scale points as possible, say r. Assuming these scale points are 


uniformly distributed, the value of each scale point p" can be generated using the 


formula, 
m= (uel) / (r-1),8ehere u = 1 ..., r. 
For example, if r=3, then p! = 0, p- = 0.5, p> = |. The same formula can be 


applied to determine the scale points for S and E. The value of r need not have the 
eemie vaiue for P, S, and E. 

Second, generate all possible combinations of P¥ , SY , EY to determine all 
Organizational states. If r=2 for P, S and E, then the different organizational states 
can be described by one of the combinations, (pl, sh Ey (pl ly E~), (pt. S2, E!), 
(P!. s*, E-), (p?, sl, E!), (p2, s!, 7), (2. s*, E+), and (P2, S2, E*). In general. 
assuming the partitions are equal for P, S and E (T =r, = r,) the maximum number 


S 
of possible organizational states that can be represented using the (P,S,E) coordinate 


form is thus r°’. If r= 2, these states can be denoted by Z| = (P73) E°) wheres 
8. Thus, Z,=(P!, $!, £4, Z,=(P!, S!, B4) Zoe scene 

Note that once each possible combination (P“, S“, E") is assigned to a specific state 
Z;,i=1,....n, the actual values of P, S, E’s in any state thereafter be refered to by P., S: 
and E;. The following Table | represents each organizational states. 


| TABLE 1 
: AN EXAMPLE ORGANIZATION ALIGHE ai 


State a5 ae ; Fy ; E;) Remarks 
| 1 (0.0,0.0,0.0) 
2 (0.0,0.0,18G) 
3 (0.0,1.0,0.0) 
4 (0.0, 10) saan 
| 5 (0, 0, One o) 
: E (1,0, 0.0 oy 
| 7 (140; 1 0nomor 
g -O)-41.00) een 


e Step 2: For each of the states Zz , 1dentifv and filter all the conceivable and 
feasible choices. 
Collect all these choices to form a set defined by D; = Sa, c({k), Where k = 1, 


Sea M1. 


task. However, it is not unrealistic for organizations to anticipate and equip 


In complex organizations, exhaustive enumeration of choices may be a difficult 


themselves with as many available choices as thev can to meet different possible 


situations. 


¢ Step 3: For an initial state Z; . pick one of available choices 


As a result of c(k), assume the organization enters state Z.. 


® Step 4: Estimate the probabilities? aoe 
oe (= \o pee 
Poi 7 Bes where } lL eeasnied me Qj Poi pj 
S.nGees Wois 21ves Spi ‘ Dj c(k) . and Ei ; pI c(k). 


c(k) = 1. Repeat for elements 


e Step 5 : Compute the row of the transition probability matrix using the 
following formula 


qj (K) = B c(K) * Soi + pj CK) * 
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pl’ p) 
herein, we notated P , S . Eas estimation probabilities of P, S, E 


e Step 6: Repeat for all remaining (m, - 1) choices in Z.. 


e Step 7: Repeat steps 3-6 for the remaining (n - 1) states. 


The general layout of the transition probability matrix is shown Figure 2.1. 





Next State 
/ aes rt 
; Zee (2 aiic Z G1s¢ 2 d13¢ 2 Maas Hie Zee | 
u eee omiymalle@ni)y e@izc(ml) qi3sc(ml) ... qinc( ml) 
r 
ie Loe ES 3} as ret 3} 25551 3} S35 5} as rel 3} 
e ee melee Giz.cl2 G2264.2 ize CieZ CZ neieZ | 
n orn aan 
ic een ere FeCmzZ yy g220C(mZ) G23C(mZ) ... e2ne mz ) 
S Zi, Et 3} 3 1Et 3} 2356 3} 2336) 3} ee as net 3} 
c Zoe Cle Coe (eZ GeZet 2 Goose (eZ oe: Gomez 
as rn 
ie pees: Sets, 
e | oan le eioree( ms) GSZG, m3) q33C(m3) ... eonc( ms) 
| | 
| Caen ie cinhewmi )sonze( mi) sqngC( mi) ... gqnnc( mi ) 
' Number of states eral caais. 70a); 
= C(l, os. * ee) 


Meancition probability matrix satisfies the condition 


y 


25 453 CCK) = 1, for k=l, ... , m; 


Number of choices in each state 
a 


a a a 


Figure 2.1 An Example Transition Probability Matrix. 


2. Goodness Measure of an Organizational State 

For each organizational state Z; , we assume there is an associated measure of 
goodness, g;. This measure is ordinal in nature and reflects the amount of benefit 
derivable from the values of P, S and E corresponding to each State) Tnewideame 
similar to a balance sheet which conveys the state of health of an organization. S$ and 
E can be viewed as assets in a balance sheet, since thev represent the strength of the 
organization. On the other hand, P can be viewed as a liability in that it detracts from 
the organizational performance. Note that high values of S; and E; imply high values 
of g;. Conversely, high values of P; impiy low values of g;. The composite amount of 


goodness for the state Z; can be expressed as follows : 


_= Pp. 9 
g Poe (eqn Zar 

In theory, the ideal state of the organization corresponds to g = 2, since P = 
0,S = 1, and E = 1. Contrarily, for the anti-ideal state, g = -1, since P = 1,8 = 0 


and E = 0. The following Table 2 shows each goodness measurement. 





tebe 
AN EXAMPLE GOODNESS MEASURE Viz 


| 

| 

\ 

| State Z. Ceres pias) Goodness Remarks 

| 1 GononOnGnmonen 0.0 

2 GO. O).Osc) oN) ao 
S CO Oy 2. OF Ce 1320 
4 (Ono, oreo) 2.0 
5 (deo On Oncne) 0 
a (OO con eon) 0.0 

| 7 (ale O ee Or OeLe » O26 

| 8 (iO Wear aon a 


3. Transition Benefit 
The goodness measure of an organizational state can be related to the 
transition probabilities through the idea of transition benefit. Transition benefit is the 


expected incremental goodness due to a transition that results from a specific choice. 
It is calculated as follows. 


e Step | : Difference of goodness value between current state Z; and terminal 


Staite Z: for choice c(k) 


(g; = ge.) aN (Pic(k) - P:) a5 (Sic(k) - Si) a8 (E;c(k) . E;) (eqn 2,5) 


Seestep 2. expected incremental benefit (G) of the choice 


G (Z; , c(k)) = Yi (g; - gi)e(k) * aye(k) (eqn 2.4) 


If there are n states and »; m; choices, the transition benefit matrix will be 
dimension of nx ); m. 


4. Identification of a Choice Policy 
We have seen that policy is a prescriptive function. Its purpose is to suggest 
Which choice c(k) out of the possible set of choices c(1,2, .... m,) must be acted upon, 
given the organization is in state Z: If rationality in decision making is assumed. 


] 
choices will have to be so exercised as to maxinize g: 


g.. This can be achieved oy 
maxumizing the sum of the expected selection and sequencing of the different choices. 
fmermard § algorithm can be employed to perform the maximization [Refs. 6,/]. The 
algorithm is applicable while dealing with a stochastic process where the law of 
transiuon and the corresponding benefit function are known. It consists of an 
intelligent trial and error iterative procedure that selects the best beneficial choice for 
each state in each iteration until the long run expected mean income per choice 1s 


maxinuzed. The following one is the dynamic programming formulation. 


MG) maxuGay-2 + >) Ws)qc,s C(a)}, fors = 1,..,S8 (eqn 2.5) 
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Note S: initial state, s : next state, g : maximum mean income per period, a : chosen 
action, Gg s C(a) : transition probability that transit from initial state S to next state s 


when action a ts chosen. 


5. Reinforcement of Choice Policies through Learning/Revision 
From a cybernetic perspective, generating a choice policy is a learning process. 
he organization should continually examine the outcomes following from the choices 
1t made in the previous periods, reinforce the assessments of the organizational 
elements P, S and E, and revise its battery of choices. This results in the re-eVaimemeemm 
of the transition probability matrix and consequently leads to a new set of choice 


policies for the next pened: 
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HI. SOFTWARE DESIGN AND IMPLEMENTATION 


A. DECISION MAKING PROCESS 

The Prescriptive Garbage Can Model refers to a class of systems Which support 
the process of making decisions. The decision maker can retrieve data and test 
aiternative solutions during the process of problem solving. This system also should 
provide ease of access to the data base containing relevant data and interactive testing 
of solutions. The system analyst must understand the process of decision making for 
each situation in order to analysis a svstem to support it. The model proposed by 
menoert A. Simon consists of three major phases [Rel. 9], they are (1) intelligence 


phase, (11) design phase, and (11) choice phase. 


1. Intelligence Phase 
Searching the environment state calling for decisions. Estimation data are 
obtained, and examined for clues that may identify problems; set all estimation 
probabilities. One of the important fact is how to formulate the problems. A problem 
formulation might have a risk of solving the wrong problem, but the purpose of 
problem formulation is to clarify the problem so that design and choice activities 
operate on the right problem [Ref. 9]. Frequently, the process of clearly starting the 
mroolem is sufficient; in other cases, some reduction of complexity is needed. Four 
Strategies for reducing complexity and formulating a manageable problem are [Ref. 9] 
°, Determining the boundaries 
®, Examining changes that may have precipitated the problem 
®. Factoring the problem into smaller subproblems 
®, focusing on the controllable elements 
A Prescriptive Garbage Can Model can obtain intelligence through searching, 
hence allow the user to approach the task heuristically through trial and error rather 
than by preestablished, fixed logical steps. So establishing analogy or relationship to 


some previously solved problem or class of problems is useful. 


2. Design Phase 
Inventing, developing, and analyzing possible courses of choices is performed 
in this phase. It involves processes to understand the problem, to generate solutions 


and to test solutions for feasibility. “A significant part of decision making 1s the 


19 


generation of alternatives to be considered in the choice phase [Ref. 10}. The acteor 
generating alternative is creativity that may be enhanced by alternative generation 
procedures and support mechanisms. In this process, an adequate knowledge of the 
problem area and its domain Knowledge, and motivation to solve the problem will be 
required. Given these situations, analogies, brainstorming, checklists can enhance 


these creativities |Rety oi: 


3. Choice Phase 
Selecting an choice from those available by using decision making 


software(.1.e., PGCM), can establish all choices for each organizational state. 


B. DESIGNING THE PGCM HIERARCHY AND DFD 
1. Hierarchical Program Structure 

To process the PGCM, we first set up estimation probabilities and alternative 
actions through intelligence, design phase. Then we also establish choice policies 
through choice phase. Herein we focus on the choice phase that consists of two 
procedures. One is to produce all matrices such as organizational states, transition 
matrix, goodness measure table, benefit matrix from given user 
requirements, specification. The other one is to apply these matrices to generate long 
run policy. Figure 3.1 shows the modules that are invoked by the main PGCM 
program. As we see, each of modules is a black box that takes input data, performs 


some transformation on that data, and process output data. 


2. Data Flow Diagram 
Since we are establishing modules as functional elements, we need to know 
what are the inputs/outputs. So for each module we will use a simple black box 
diagram to show the data flow of PGCM. For example, in Figure 3.2, (heremiems 
module labeled benefit matrix. Independent of all other modules in the program, we 
need transition matrix and goodness mieasure table. The followings are the 


inputs. outputs parameters for each module [Ref. 11]. 


inputs : number of scale points for each factor (1, ica) 
number of different choices for each state 
estimation probabilities 


process: store input data via user interaction 
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Output : estimation probability table 


po Ge. ft 


Get- Cetus) 
matrix choice 


Get- Get- 
goodness benefit 


Get- 


state 
mat. 





Resolve Setnew 
Variable action 





Figure 3.1 Hterarchical Program Structure for PGCM. 


m evlodule Getstate (level 1.2) ** 
input : number of scale points for each factor (Tp eee, 
process: combinate all scale points 


Sieput ; Organizational state table (size: n = r. * r, * ts) 


** Module Gettransition (level 1.3) ** 
Inputs : estimation probabilities 


Organizational state table 


Z| 


process: calculate transition probability using formula 2.1 


output : transition probability matrices (size:n* (> m, * n)) 





Lee 
— scale—/State ee —— Benefit 


Si tion \ Cale 
\ data 
| D1 EStimetion Transition benefit 








Policy 


| 





ssource/ — -process ae :data flow 
cestination 


Figure 3.2 Data Flow Diagram for PGCM. 


input : organizational state table 
process: calculate goodness measure using formula 2.2 


output : goodness measure table (size : n) 


to 
ty 


== Module Getbenefit (level 1.5) ** 
inputs : transition probability matrices 
goodness measure table 
process: calculate transition benefit probability using formula 2.3, 2.4 


Output : transition benefit matrix (size : n * maxchoice) 


ee vlodule [nitialize (level 2.1) ** 
Input : transition benefit matrix 


process: select best choices for each state from transition benefit matrix that 


has the highest value in that state 
QUtput : policy table (size: n) 
*™ Module Dvynamicformulation (level 2.2) ** 
inputs : transition benefit matrix 
transition probability matrices 
temporary policy table 
process: fill the coefficient table need to solve equations described by formula 2.5 
Smreut : coellicient table (size: n * n+ 1) 
= Module Resolvevariable (level 2.3) ** 
ieut < coefficient table 
process: resolve variable using gaussian elimination method 


Output : variable values 


eS Module Setnewaction (level 2.4) ** 
inputs : variable values 
transition benefit matrix 


transition probability matrices 


i) 
2 


process: set a new policy using howard algorithm 


output : new policy table 


C. PGCM PROCESS ALGORITHM 


1. Input Data via Terminal 
The current PGCM system needs to know number of scale points for each 


factor, different number of choices, and the estimation probability. 
2. Generate Transition/Benefit Probability(formula 2.1,3,4) 


3. Value Determination Operation 
a) establish n linear simultaneous equations (Vv; , g). 
USE qi: and i(S,a) for a given policy to solve 


1 = j og. yi = ie? 
Ca et, eae e qj Yj | 2 


b) set arbitary v; equal to 0, normally v,, 


c) resolve and produce the relative values using gaussian method. 


4. Policy Improvement 
a) find the alternative C(k) that maximizes the test quantity (Vv; , g). 
: find max{i(S,a) C(k) + ¥ dij C(k) Vi} using the relative values 
v, of the previous policy, then C(K) becomes the new decision in the 
ith state, 1(S.4)°Ci Kk) becomes (Sa) ane qij C{K) becomes dij 


b) perform this procedure for every state, and determine a new policy. 


5. Combined Operation in An Iteration Cycle 


a) select an initial policy from immediate benefit values. 
b) solve the relative values v; and g by setting v,, to 0. 
c) find an alternative that has maximal benefit values. 


d) if all alternatives are equally same benefit values, leave it unchanged 


1) sort benefit values (1 .. choice(.n.)) 
2) calculate absolute difference for each benefit values 


3) if a difference 1s less than 0.0001, take an old action else set 


a new action 


e) repeat until the policies on two successive iterations are identical 


f) if gain value g is decreased, then set arbitary v;_, equal to 9, 
and repeat step3 thru step 5 until satisfied 
The above algorithms step 3 thru step 5 based on the policy iteration method 


for multiple chain processes [Ref. 6]. 


D. IMPLEMENTATION WITH OFFENSIVE OPERATION EXAMPLE 

Decision making in battle field involves unclear problems, chance event solutions, 
fluid energy derived from participants, and choices that seldom resolve problems. At 
any moment in time, a battle field may have a large number of problems to deal 
with, different possible solutions to cope with these problems, and many participants to 
make the necessary choices. Since taking into account all of the problems 
simultaneously could confuse the illustration, we shall assume that there is only one 
problem to be addressed during the interval of time considered and that the problem is 
related to offensive operation. We assume the representative elements in the offensive 
operation are number of attack forces, weapon systems, weather, relation to the 
consequent military operation. Figure 3.3 shows a system flow chart of the 


Prescriptive Garbage Can Model process. 













Prescriptive Garpage Can Model 


Estimation Probability 


pecan eae 
Howard Algorithm 






User 
Pacteraction 






Result 









pleuresssc) ovstemm Flow Chart of PGCM. 


1. User Interaction 
a. Define the problem and determine the organizational states 
Once we define the problem and number of scale points for each factor, we 
can combinate the organizational states. We shall limit the number of scale points to 
P = 3 (0, 0.5, 1.0), S = 3 (0, 0.5, 1.0), E = 2 (0, 1.0). Thus, if we take intomieeamam 
ail the combinatons of (P; , S; 
Organizauonal states. Table 3 shows the description and the organizational states of 


= 
— 


, E;), we can have at most 18(3x3x2) possible 


Uns Oroulem: 
b. Identify and filter all the conceivable and feasible choices 
In this example, we choose onlv 4 choices towards solving the offensive 


operation problem. They are 

C(1) : Smoke operation and do attack 

C(2) ; Supporting high performance weapon systems 
C(3): Reinforcing attack forces 


C(4) : Changing attack forces 


For instance, (0.5, 0.5, 1.0) is one of these combinations denoted imeem 
Table 3. by Zjo. [t can correspond to a situation where an offensive forces have a 
good chance to attain their objectives successfully since they have no significant 
problems. But the mulitarv expert may have some questions such as the enemy's 
recovery abilitv from the previous shock or friendlv forces’s risks caused by a little 
shortage of attack forces, etc. So the mulitary expert may look for another action to 
protect friendly forces such as a smoke operation. A smoke operation can significantly 
reduce the enemy's effectiveness in both the day time and at night. CombGinegi aa 
suppressive fire, smoKe will provide increased opportunities for maneuver forces to 
deplov while minimizing losses. Also the effective delivery of smoke at the critical me 
and place on the battle field will contribute significantly to the combined arms team 
Winning the first battle. Therefore, we we choose a sinoke operation as one of feasible 
choices. The rest of the choices are also chosen in a same manner. Generallveegen 
state mav have a different set of feasible choices for each state. For example; wom 
pick out C(4) since Z¢ is an ideal state we don't have to retain on C(4) which can be 
selected in the worst situation. so Z¢ has 3 choices. Hereby, we bring an interface 


problem between PGCM and expert system that identify and filter all the conceivable 





ipa DUES 
DESCRiy TiOMeRe ROBLEMS AND ORGANIZATIONAL STATES 


E Pies able Cromer Om Memo EG De solved 
ae Degree of effectiveness in problem-solving 
5 Potential energy of participants 


po -Ome CmoeD i nicapt. Dreblem regarding attack forces 
mission load, weather, relation with consequent 
igi ODS tac de® a 

p2=.5 Moderate shortage of attacking forces, not good! 
weapon System good weather, a certain ome = delay, 
Pembele ee Ol Seelem Emomera elOn | 

p3=1l Acute shortage of attacking forces, ae mission| 
load, bad weather, a tremendous time delay to the| 
consequent operation | 


field, poor coordination with adjacent ete 
Reon Pepeeriance weapon SYSeECMS 
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Mi C0700 ©. © 
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= ORO. >, 1. 0 | 
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7 Ore57 022000 | 
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9 Omen Ges 0.0 
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and feasible choices, if our problem has hundreds of organizational states. That system 
certainly helps all experts. For the simplicity, this example has all the same number of 
choices for each state, and Appendix D shows a different number of choices for each 


Bcc, 


c. Estimate the probabilities using expert judgement 
Using expert judgement. estimate the probabilities P 
Dees d) 2 - 
12, ss 18 and 2 eee pi’ pj 
c({k) . and Ebi Dj c(k). Given P; = 0 and C(1), P; may transit to a new state P; ; 
where P; can be 0, 0.5 or 1.0. By examining historical data and gathering advice from 


pi ‘ pj c(k), where } = 
k) = 1. Repeat for elements $ and E. This 2ivesme 


senior officers or military experts, assess the degree of influence of changing attacking 
forces on P. and translate the assessment into matching probabilities, Ege 0 C(1), Can 
9-5 CCU). Po . y C(t), with which each of these three transitions can take place. In our 
Case, These probabilities are shown below. 


is 


Poi pj CO) 


Ininal State P; = 0 Choice C(1) 


Terminal State 
a — *~ = (5 I. = 
DP; 0 P; 0.5 DP; 1.0 


0.98 0.0] 0.01 


The values shown in the table implies that if there are no major problems 
regarding offensive operation at the present time (since P; = Q), then the chances are 
iow that new problems might occur merely on account of changing attacking forces. 

We now consider S; , the effectiveness of solutions. Let 35 = 0 be the 
initial state of S:. Focus on the same choice C(1). As before, we estimate the values of 
So +9 CU). Sg - 9-5 CCL), Sg. yg C(l). Their values in our case are shown below 


Spi + pj 
Initial State S$; = 0 Choice C(I) 


Termunal State 


| S; = 0 Sj = 0.5 Sj = 1.0 


eT 0.02 0.01 


We also consider E 


scale points. Let E; = 0 be the initial state of E;. consider on the same choice C(1). 


the potential energy of participants that has only 2 


Their values in our case are shown below 
C(1) 


ere 
—pl’ Pp) 


Initial State S; = 0 Choice C(1) 





Terminal State 


> 0.05 


2. Transition Probability Matrix 

Use formula 2.1 to compute the row of the transition probability matrix, qj 
C(1), corresponding to state Z, and choice C(1). In this step, we consider all the three 
elements discussed above together to generate the Joint transition probabilities, for the 
initial state Z, (0,0,0) of the battle field, due to changing attacking forces. Repeat to 
generate an transition matrix for the remaining I7 states. Table 4 shows the transition 
probability matrix of Z,;. The upper part of this table is an application of formula 2.1 
In connection with changing attack forces and the lower part is for the remaining 
choices, C(2), C(3), and C(4). The remaining transiuon probability matrix, Z>,... .Zy¢ 


will be shown in Appendix C. 


3. Goodness Nleasure 
The goodness measure for each state is computed using formula (2.2). The 
resulting g values for our example are given in Table 5. As shown in Table 5, state Z¢ 
ferresenis the ideal state in that it vields the highest possible benefit, i.e... g=2. 
Conversely, the anti-ideal state, £13, is the most adverse state for the organization 


since the corresponding benefit is the lowest. 


4. Transition Benefit Matrix 
Based on the transition probability matrix and the vector of goodness 
measure, compute the transition benefits using formulas 2.3 and 2.4... The result of 


performing this procedure for all the initial states is shown in Table 6. 
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5. Generate the long run choice policy 
The objective of this step is to determine the offensive operation policy by 
evaluating what choices result in highest benefits in the long run as the battle field 
stochastically transits from one state to another. The mathematics of maximization of 
the long run benefit, when the law of transition shown in Table 4 and benefit function 
shown in Table 6 are known, can be achieved using Howard’s algorithm. Let’s trace 
the long run choice policy by applving forniula 2.4. 
a. Initialize policy table 
Select best choices for each state from the benefit matrix that has 


maxiniumi value among C(1) thru C(5), and set up a policy table as the following table. 


Origin Ghioice Policy Tabic 


| §1$253.. $7$8S95S10...S15 $16 S17 S18 





b. Resolve variables and evaluate max property 
Once we have resolved all the variable values (\(1), ... , v(18), g) using 
gaussian elimination method [Ref. 8} we check to see if these resolved values satisfv the 
maximal property expressed in formula 2.4. For each state-action pair S.a, we evaluate 
(Saj-g + ) \(s)qg , s C(a) and then for each state S choose the maximizing act “a” 
[Ref. 7]. This leads to 


Staccato.) v W(S)Giciees C(a) 

(1,1) 0.055-g +0.903070v(1)+0.047530V(2) .. = 1.00E+00 - g 
(1.2) 1.235-g+0,039200V{1)+0.156800v(2) .) = 1-00E + UUme 
(1,3) 0.340-g + 0.617400v(1) + 0.264600V(2) .. = 1.00E +00 - g 
(1,4) 0.800-g + 0.018000v(1) + 0.072000v(2) .. = 1.00E+00 - g 


(10,1) 0.220-g +. 0.000019¥(2) + 0.001881v(3) .. =-6.25E-16 - g* 
(10,2) 0.730-g + 0.000070v( 2) + 0.006930v(3) .. =-1.50E-15 - g 
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(10,3) 0.640-g + 0.000400v( 2) + 0.007600V(3) .. = -1.62E-15 - g 
(10,4) -0.300-g + 0.006000v(2) + 0.014000¥(3) .. =-8.60E-16 - g 


c. Set anew policy table 
At the above step, we observed a new policy, marked by the asterisks and 


thev are 


New Choice Policy Table 





pmo) Ooo? O10... 915516517 S18 
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ad. Compare a new policy table with a previous one 
Repeat b) and c) until a new policy table and a previous policy table 
correspond each other or the maximal income per unit time (g) is decreased. The latter 
case ,occasionally happens, and 1s possible in the case of g value near zero. For this 
unstable state, we set recursively arbitary V;_, equal to 0, and repeat a) thru c). 
e. Test result 
As a result of prescriptive garbage can model execution, we lay down a 
policy table shown tn Table 7 that have solved expressed by formula 2.5. Given Table 
7 recommend and advise the commander of the best choices available in a specific 
organizational state. For example, if given situations are (i) Acute shortage of 
attacking forces, big mission load, a tremendous time delay to the consequent 
Operation, {11) Most of personnel have no experience in the battle field, poor 
coordination with adjacent, poor performance weapon systems, (il1) Not quite proud of 
their operations, we would like to change attack forces known as choice 4 to achieve 


his goal. Like this we can select choice | (do smoke operation) in state 6,10,18. choice 


2 (supporting high performance weapon systems) in state 1,3,4,7,8,9,11,14,15,17, choice 


f 


reinforcing attack forces) in state 12,16, and choice 4(changing attack forces) in state } 


TX Bike 
SELECTED CHOICE POLICIES 


State Choice Polley | 

a. C( k) | 
1 2 
| 2 x 
> 2 
| = Z 
| 5 4, 
| 6 1 
? 2 
8 2 
9 Z 
10 il 
ii 2 
2 3 
4, x 
14 2 
iS Z 
Lo 3 
17 2 
18 i 


IV. FURTHER RECOMMENDED STUDIES 


This thesis considers a prescriptive garbage can model to advise the participants 
of the choices available to them in a specific organizational state, and implements it to 
generate a choice policy table. The current system covers chance events resulting from 
the interactions of four elements in the organizational context, (1) problems, (11) 
solutions, (111) participants, and (iv) choice opportunities. The computer program could 
be modified to process a greater number of organizational states depend on a memory 
allocation(current system maxchoice 5, maxstate 36). 

An ideal PGCM wouid be one that interfaces with an expert system to 
automatically transfer estimation probabilities and feasible actions about the 
organization problem into PGCM system without human intervention. The following 


diagram shows how an expert system would be used. 


Decision Maker 


estimation prob 


alternative actions 


supply estimation- process 
prob. and actions 
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An expert system uses methods of reasoning to eliminate bad courses of actions 
and to determine the best courses of actions to achieve a goal. Expert systems use 


information in an intelligent way to perform tasks that are normally associated with 


human experts. There are many anarchic and random situations, but human experts 
have some difficulties to find the best choice every time. Hereby we illustrated a 
diagram as one possible model to interface between PGCM system and expert system 
to determine the best actions for the given set of organizational states. The next step 
in this study is how to interface an expert system to estimate transition probabilities 


and feasible actions for input to the prescriptive garbage can model. 


ae SS es 


APPENDIX A 
A SOURCE PROGRAM 


PROGRAM PGCMPROG(Input, Output); 
(*$s 400000 *) 


UBARAKAAAARKARAXKARKKKKAARARKAKKKKRARRA RAK KA KERR RRARRARKRARRERK 


a TITLE Unseen rE eve GARBAGE CAN MODEL ss 
See AJIHOR | sag Kaag, sun Ho a 
meee Date Written : 11 Feb - 19 May 87 es 
x kK 
xk §6Product saVenclen, Ir. x 
xk System Used : IBM 3033 VM/CMS zx 
kK Kk 
xX I/O Process : Terminal Keyboard ** 
KK ke 
Boe Description = fhis program is an interactive fom 
Sus choice processing system to support ** 
aac decision aero by using Prescriptive** 
xa Garbage Can Model ar 
RRERKKKRKRKKKKK KARR KARA 


KKAKAAAKAKAAKKKAKKARKRKRRKKK KKK KK ZX ) 


m= Global Constants **) 


Eonst 
Zero = 0; 
one =e 
two = 2; 
three = 3; 
BOUL = 4; 
ax = 6; 
eight = 8; 
ten = 10; 
seventy = 70; 
maxfactor = 3; * number of variable 
maxchoice = 5; * number of maximum choice for each state 
maxscales = 5; * number of maximum scale point for one factor 
maxstate = 36; (* number of maximum states 
maxstateetc=37; (* number of maximum states plus one 
mMaxrow = 180;(* number of maxsrows, max-state*choice 
Eype | 
counter = 0..maxint; 
inputtype = record 
line : array(.one..seventy.) of char; 
length ; counter; 
reals t ; counter; 
end; 
commands = ee EXECEXIT, BAD); 
Peemisagse — (CADEINE, NOINPUL, NOINTERACT, ETCVAL, ETCCHO, 
NONNUM, OVERSTATE, IMPOSSIBLE) ; 
choicetable = array(.one..maxstate.) of integer; 
transitiontable=array(.one..maxrow, Suen ecate of real; 
Benefittable = array(.one..maxstate, one..maxchoice.) of real; 


policytable array(.one..maxstate.) of integer; 


(**X Global Variables **) 


var . 
Possiblestates, 
mae, Vi eee Cela: 
eat : real; 
wait eee. 
choices ; Choicetable; 


tranmatrix: transitiontable; 
benematrix: benefittable; 


ae Aa oe 


policy 


userinp 
command 


helpfile 


quitnow, 
goodvalue 


: policytable; 


: SUPER Eee 
: commands; 


text; 


: boolean; 
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HHHHEPHHHEPHPH HHH RHE THAR R RHR TR HR TT 
as sas 
Function getinp(var userinp : inputtype) :boolean; 
{* Get a single-letter command, | 
making sure it is in the set of valid commands *) 
var 
Pech : char; 
Begin 
userinp.length 0; 
userinp.las s= Q; 
emeoe Eheneget pes false 
elsemeegin 
while not eoln do begin 
Beda (cn): . 
if userinp.length < seventy then begin 
Wocwinoe ene —susehino. Length + 1; 
userinp.line(.userinp.length.) := ch; 


end 
end; 
readln; 
getinp := Erue, 
eve 
end; (*getinp *) 


Function skipblanks(var userinp : inputtype):boolean; 
var 
blank : boolean; 
begin 
blank := true; . 
pee userinp. last < userinp.length) and blank do begin 
Meewinipelast <= Useninp-last + J; 
maruseriipswine(.userinp.last.) <> ' ' then 
blank := false 
enc: 
if not blank then 
Boeritip. last ;= userinp.last - 1; 
ere cis := Been 


end; (* skipblanks 
* SS S535 SS Sa SS SS SSS SS SS = * 
; a Procedure Getchar === A 


rocedure getchar(var userinp:inputtype; var ch:char); 
egin 
Memuserino. last < userinp. length tnen begin 
Mscr lo skaee ¢- uséerinp. last + 1; 
ch := userinp.line(.userinp.last.); 
end else 


em := ' '; 
egeee (* get char *) 


* <<< eo I <<< << << =. =<. =.=... = on om * 
* === Procedure Writeuser === * 
a eee ee eS SS SS SS SS SS SS SS SS SSS SS SS Sess lO 


rocedure writeuser(msg:usermsgs) ; 
egin 
case msg of 


BADLINE : writeln('Bad Input, try again <press enter key>! 


NOINPUT : writein('Have no data, try again <press enter key>'); 
NOINTERACT: writeln('Nothing typed, oe again <press enter key>'); 
NONNUM : writeln('Nonnumeric data ry again <press enter key>'); 
EICGVAG : Degin 
write ee ee scale vo : 2 to 9, try agai 
writeln '<press enter key>' 
end; 
ETECHO : begin 
write eet eee choice : 2 to 5, try again ye 
Wasteen <press enter key>'); 
end 
OVERSTATE : begin. 
write . Maximum organizational states is less Me 
alias "than 36, try gauss <press enter key>' 
en 
IMPOSSIBLE: begin 
write , Cannot set up, try ae with new data '); 
writeln('<press enter key> 
end; 
end; 
readln(wait); 
end; 


KRRAKKAKARKKKAKKAKAKRKAKAAKRKRKKAKKKAKKAAKKKKRKKKAKKRKRKER 


AKAAX Function Getcommand SESSESTS 
( RRAKKARRAAAA KARR KARARRK RAR KARA RAK AK RAR ARR KA KK 
Function getcommand(var command:commands) :boolean; 
(* Get a single-letter command, 


make sure it is in the set of valid commands * ) 


avr 
en : ena 
userinp: inputtype; 
begin 
page; 
WEL LO Ln (RAR RARAR AAR ARIA KIARA ARIK AIA RAR AAAI RAIA RAK RAR AR AR AL G7) 
Write ln AK AKA ee : 
writeln('*** GCM Program Options are the followings AKK' 6m 
Writeln( | *** --------------------- - 2 ~~ ARK! 367); 
writeln( | *** AKK' 367); 
writeln(!*** KKK 61a 
writein('*** 1, ExecGCM (Execute GCM Program ) xAK'! 367); 
Write nee x* KKK! 367); 
WEL Gel ne AA* 2 SxechxXit RXecutlon suop ) AKK' 267 Ms 
writeln( |! *** ARK! 367); 
writeln(!*** =====> Type, Number Prey AA! ; OU 
BOL Ee LL SSC ICRC ARTS a SR RR Fa I SoA ICT AA TI ATR oR : 
getcommand := false; 
command := BAD; 
if getinp(userinp) (Ehee begin 
getcommand := tr 
EO & sitipblanks (Userinp) then begin 
getchar(userinp,c 
if skipblanks (ugeranp) then 
Le “Chia 2 2r thenm 
case ch of 
'1L' = : command := EXECGCM ; 
'2' : command := EXECEXIT; 
end 
else getcommand := false; 
end; 
end; 
end; 
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i Ee eerie enn ee ene ‘i 
x #He GC OM PART ee HHH * 
x #4 Generate Matrix HHH * 
* Ree “_ HHH x 
x #44 generate transition probability,  #H# * 
x $at fransition benefit probability, HEH * 
x #44 organizational states, goodness ##¢ *) 
bs +#i# measure table: Input for Part III ### *) 
(* FHHHHHSHHRHHHHHAHHHERHHAHRHREHAHRHHHTESHHEE 7X ) 


eo GET TRaSeDION” SENEFIT MATRIX Can 


KREKKKAKKKKRKAKAARKKAARKRKRRRKRKRKRRRKRKRRKKRRKRRRRKKRKRARKR 
KKK KK KAKKKKRAKRKKRRKRRKRRRRRRRRRRKRRRKRRKRAKRKRRKKKK 


Procedure Getmatrix(var possiblestates:integer; var choices:choicetable; 
var tranmatrix:transitiontable; var benematrix:benefittable), 


const 
maxXlrow = 45; 

type 
scaletable = array pp oaegen enc roe:) of integer; 
scalevaltable = array (.one..maxscales, one. .maxscales.) of real; 


estimationtable=array(.one..maxfactor,one..maxirow,one..maxscales.) 


of real; 
combination = record 
Sole : array (.one..maxfactor.) of real; 
end: 
statematrix = array ee cere of combination; 
goodnessmatrix = array (.one..maxstate.) of real; 
var 
HUMEACTOH, 
maxcho : integer; 
scales : scaletable; 
scalevals sca levaiseaple; 
statmatrix meseacemaclik 
goodmatrix : goodnessmatrix; 
estmatrix : estimationtable; 
K RKAKKKAARAKKARRKKKKKAAARRARAKAKRRAKAKKKRKRKARK OK 
xxx Get Number of Factors ana : 
K KKKAKKKKAAKAKKARAAKKRARKKKKKARARAAKKKARRKRAKKEK OF 


Maoceaure gethumoffactor(var numfactor:integer; | 
var possiblestates:integer; 
var scales:scaletable) ; 


a 
a integer; 
ch . eee cia 
indomain : boolean: 
* = oe oe oe oe oe ee ae ee ne ae ae ae me ae me came ams ms are om aus a> ams One Gum Gam> Guay GD GD GD OD GD OD OS GS Ga OD OD * 
=== Function Get Max # of States === : 
ee ee ce as om es es es cs es VN ce ce es a a 


Function Getmaxnum(num : integer; scales : scaletable):integer; 
var 
base, 1 : integer; 


begin 
base s= one; 
for 1 := 1 to num do 
base := base * scales(.1.); 
getmaxnum := base; 
end; 
begin — 
Ch alae ObAGac Ono 7S. == Fe S, EE! )- 
mritein(! Poe); 
writeln; 
numfactor := 3; 
Poe # of scale points for each factor : i 
wetteln( ' me 


4] 


writeln; 


eromen := false; 

repeat | (*repeat 1%) 

ai 

repeat Crrepeee 2%) 
goodvalue := false; 
writeln(! face igen eee 
ae getinp (user inp) then 


in 
at not skipplanks(userinp) then 
begin 
getchar(userinp,ch); 
ie skipb lanks (user inp) Ke en 
ECC Ue ,'5', "6! °F" 58" | ' 9S eee 
begin 
case oe of 
Ze int := 2; 
'3' : int := 3; 
'4' 3; int := 4; 
LSU Int “-=s5 
"6" =/ant <= 6- 
17 2 int == 7- 
So een --= er 
oo Int <= 29) 
end; (Aeaseendn) 
oodvalue := true; 


end (cendut che) 
else writeuser(ETCVAL (~elsenein) 
else writeuser(ETCVAL) (*else shipblanks*) 
end <~endat notskt pene 
else Ue iPUT) (*else notskipblanks*) 
end (*endif dee ud 
else writeuser(NOINTERACT); (*else getinp*) 


1f goodvalue then 


begin 
scales(.1.) = Ine 
1:=i1+41; 

end 


until (i = numfactortone); (*end repeat2 *) 


(XAAAAAKKAK check and correct scale point ~~"427 77a 
repeat Vaeeat say 


writeln('s# of scale points are : '); 
ror 1 := one to numfactor do 
writeln(' factor’, 1:2, ! se ', §cales(.1 ue 
writeln('goahead : Press any key, correction : "%"'); 
writeln;: writeln; 
readin(ch : 
if ch = '%' then begin 
writeln('Enter foot number and value : '); 
readin(i, scales > en 
until net(en-= 994°. Sand repeat3*) 
possiblestates := getmaxnum(numfactor, scales); 
indomain := (possiblestates <= 36 


if not indomain then writeuser (OVERSTATE) ; 
ee indomain; (*end repeat 1”) 
en 


KR RRKEKKKKKKRKRKRKKRKRKKRKRRKRKRKRRKKRKRKRKRKRRRKEKRRKRRKRKRARRERRK OR 


x kKK Get Number of Choices KKK * 
HK KKK KKK ARK KRK KERR KKK RRR RRR KRK EKER KK 


Procedure getnumofchoices(numfactor:integer; possiblestates:integer; 
var choices:choicetable; var maxcho: integer); 
var 
1 : integer; 
els seaciiclia: 
begin 


write Get Number of Choices for each State Z(1i) Uys 
werteln('? = 1 ..',possiblestates:3); 
write a. 


wrire ln | TY. writein; 


Cae R AR Gee number of choice RAK KKKKKK KK AK ) 
1 3;:= 1; 
Repeat 
goodvalue := false 
Pi aernenials Eajeew | Hl; «3, ae 
ee getinp(userinp) then 
begin 
if not skipblanks(userinp) then 
begin 
getchar(userinp,ch); 
hae skipb lanks (user, inp) then 


Je Giese oa! oh be) then 
begin 

case Chao 
LZ eecliiem = 2 
ESS eee = 3s 
el eA = 

NO! 4 einG c= 3: 

end; (*caseend*) 

oodvalue := true; 


(~enGi @scm) 
ae writeuser (ErécHo) (Xelse ch*) 
else writeuser(ETCCHO *else shipblanks*) 
end (*endif notskipblanks* 
else Here ees PUT) (*else notskipblanks*) 
end (*endif cee) 
else writeuser(NOINTERACT); (*else getinp*) 


1f goodvalue then 
begin 
GnOuses (oars eam SLilG; 
1:=i+1; 
end 
until (i = possiblestatest+one); (*end repeat2 *) 


ELE EKES check and correct Sask LAs) 
cine State Z(i) feOe choices! ne 
writeln : 
Be Deac. 
for i := one Lc possiblestates do 
writeln(1:6 yecuouees( .i4)- : 
writeln('goahead : Press any key, correction : "%"'); 
WEleein-: writeln-: 
readin(ch) ; 
if ch = '%' then begin 
writeln('Enter state number and value : '); 
readin (1, choices(. i.)); end; 
Cite not(ch =!) - 
Maxchio := =399> 
for 1 := one to possiblestates do 
PEecworeces (= 1 > Maxchor then maxcho := choices(.i.); 


end; 


xR AKK Get Estimate Probabilit: ARK XK 


KR KRKEKRKKKKKKKKKRRKRRKRKKKRKKRKKRKKRRKRKKKKAKKAKKRAKK K 
KR KRAKKRKKRKRKKKKKKKKRKRKKKARKARKRKKRKRKRAKRKARKAKKRR OK 


Procedure getestprob(numfactor:integer; maxcho:inte 


scales:sca etable: var scalevals:scalevaltable; 
var estmatrix: estimationtable) ; 


var 
mik,l mm: integer: 
: real; 
ch : char; 
* es see emer st cme (mes mes Cones mf seco er mm comer cme cms “omen om omer cm me foe ae cpr fe fee oe mee eee cee ome meme a * 
te === Get scale points of each factor === x4 


Procedure Getvalofscale(num:integer; var scalevals:scalevaltable) ; | 
var 


iar : integer; 
p real; 
Degin 
for 1 = "1 seounumede 
for 3 <= Ito sealesi 21.) )deueegan 


j-1)/ (scales (i »)-1); 

:= round(p = 100): 
scalevals(.1,j.) := k/100; 
end; 


AO 


end; 
begin 
getvalofscale(numfactor,scalevals); 


KARKKKKARKR Get estimation robability RAKKKAKKK KE ) 
rea Estimation Probabilities 5) 
writeln 
writeln; 
for ol = one to maxcho do 
for j := one to numfactor do 
begin 
writeln(' (factor) ie es 
for k := one to scales(. se 5 do 
begin 
write | sealeval State ee 21, a E) 
c 


f 


writeln(scalevals(.j,k. oice C(',i:1,"ae 
writeln('Terminal State : ve 
for 1 := one to Sa de 

Whlre = (|! pine! es ee, 


ee read eeeamatien probability “277 
or 1 := one to scales(.j Oo 
read (estmatrix(.7, ce Aye sCaMee 5.) pe 
readin; 
end; (*end k*) writeln; writeln 
oo check and correct ARRRARRERRERER ) 
repea 
eet 2:10); 
for k := one to scales(.j.) do 
Wise ©: DiGi a e.e se ie Eu cane 
write(' ':10); 
for Kk i= one tolscales( mae . 
write (scaievais(. i, io Be <6:2, ° © ew Gein 
wrtcet | ao 
for k := one to scales(. ja) ae 
write ('------- vee ene 
for k := one to scales(.j.) do 


writey )) 25 sie ee eae 
oY ol.3=-one (te scales(. J:) 
WET ee kes Uae jac he 1) aL ee j.)+k,1.):6:2, “ae 
writeln; 
end; (end k*) writeln; 
writeln(' goahead : Press any key, correction 
Welte ln wra tela. 
readln(ch) ; 
22) Ch ene begin 
Whee era Choice, row, col, prob umm 
atserellons Ih Phi 
estmatrax(. ay (ie *scales(. |. )+l[me)° <= Dp; "ende 
until snot (ehe= —)% ie 


end; (*end j*) 


terete + 
ae 


procedure Getstatmatrix(numfactor:integer; Set ee soca oe :integer; 
scales:scaleta scalevals:scalevaltable; 


var statmatrix: pee cee 


var 
i 
MOcr, oe et Cn teC ete. 
begin 
mult := one; 
fou teeewone Lo numractor do 
begin 
mult := mult * scales(.i.); 
loop := possiblestates ane ‘mult; 
peg 0- 
former one to mult co 
begin 
Pete > Oeste; | 
Poco mscciles@.ma)atHemsDtr s:= (ptr mod scales(.i-)); 
EOGeKs= One ito loop do 
3 statmatrix(.(j- peer. ppeolumn .i.):=Scalevals(.i,ptr.); 
ena: 
end; 
end; 
x ae one ons oe as oe one ons as one ae oe one one ones one os oe oe oe oe oe os os Gs Ses oe ot oe oe Ge Oe os oe oe oe es oe oe oe oe * 
f === Procedure Print State Matrix === : 


procedure printstatmatrix(numfactor:integer; Ree integer; 
statmatrix:statematrix 


viet 


Bao 
Mecca lop Chmede ep en - tmcLeger, 
begin 
page; 
weiteln(' Egy 
writel Po ane States! :57 
writeln Wee) 
writeln; writeln; 
writeln(' 270) 
nel telni(! NumSer of factors aopemuicactor < 1 
writeln('! State eee of Scale eineet 67) 
writeln(' 1370); 
for tableptr := one to possiblestates do 
begin 
write(' ':23); write(tableptr:6); write(' ':9); 
FOR ase: := one to numfactor do 
Peace moramnce Ix eagleptr.).column(.colptr.) : 6:2, ' ':2); 
eae 
en 


writeln(' PO yes 


procedure printhelpfile(numfactor:integer; eee integer; 
statmatrix:statematrix 
var 
eelptr, 
Mescecatcptr, tabléeptr : integer; 
begin 


page; 
rewrite(helpfile, 'helpfile data'); 


writein(helpfile, ‘Organizational States! :38); 
writeln(helpfile, | eS 


p 
writeln helpfile); writeIn(helpfilé); 


write (helpfile, Eee): 


2 
7 
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writeln(helpfile, ' er 
for tableptr := one to possiblestates do 


begin , 
Tee eee tableptr:6); 
write(heloriie =.) 
for Colptr := one to numfactor do 
write(helofile,statmatrix(.tableptr.).column(.colptr.):6:2); 
writeln(helpfile, ' ':2); 
end; 
write (helpfile, ' le 
writeln(helpfile, ' ae 
end; 
Ss SSS S55 >>> SSS > >>> >> 255252 > EE * 
* == Procedure Transition Matrix <= - 
A S22 SSCS == 2-25-52 - >>> => == _ 


procedure gettranmatrix(numfactor:integer; possiblestates:integer; 
choices:choicetable; scales:scaletable:; 
scalevals:scalevaltable: 
estmatrix:estimationtable; 
statmatrix:statematrix:; 
var tranmatrix:transitiontable); 


var 
int, Nexee 
cho, columns, . 
pointer, f£lystptr, secondper = taregqe. 
getprob, multiprob : real; 
_ found - boolean: 
Deg 1 — 
for init := one to possiblestates do (* loopl *) 
for Cho ~:= Onemto chortcestsinit.) do (* loopZe*) 
for next := one® to possiblestates do (* tocesas 
begin 
multiprob:= 1; 
for columns := one to numfactor do (* loopam: 
begin 
pointer := QO; 
firstptr := 0; secondptr := 0; 
found := false; 
While not found do 
Be gata . 
pointer := pointer + 1; 
if scalevals(.columns, oie = 
statmatrisc( Hine oe eeaininen .columns.) then 
firstptr +=" potnecm 
1£ scalevals(.columns,pointer.) = 
statmatrix(.next.).column(.columns.) then 
secondptr := pointer; 
pe <= not ((flrstptr~secondper =e, 
end; 
secondptr := (cho-1)*scales(.columns.)+ secondptr; 
getpro := estmatrix(.columns,secondptr,firstptr.); 
Tee = multiprob * getprob; 
eller 
(* end of loop4 *) 
tranmatrig(. (ini oo ec eS eee := multiprob; 
end; 
(* end of loop3 *) 
(x end ct dlooez, =) 
(*~ end of logo la 
end; 
cs a 
bs == PROCEDURE PRINT Transition Matrix == * 


procedure printtranmatrix(possiblestates:integer; choices:choicetable; 
tranmatrix:transitiontable) ; 


var 
columns, 
init, next : integer; 
membabtay saarray (.15.5.) of real; 





begin . 
for init := one to possiblestates do (* loopl *) 
begin 
ages 
Veen ae : 
writeln('Transition Matrix' :47); 
wed ere 1:47 
Weicein: 
writeln, =. S, 
Wei_tein( “Initial Statewsa  1nit:3); 
write Ns 
writeln('! ry 
write 'state be 
for scOLuMmMs ess one to choices(.init.) do 
Veber cOlLUMmmnor] a’: 10 )> 
writeln; 
write , je 
writeln(' vy; 
* erase *) 
or columns := one to choices(.init.) do 
temparray(.columns.) := 0; 
for next := one to possiblestates do (* loop2 *) 
begin 
write(next:4); | 
Fom@eeolunmns <= One to choices(.init.) do begin (* loop3 *} 


Webber tranmatrix(.  wnit-1 )~choices( .init.)+columns, next.): 


(x erase *) 
temparray(.columns.) := temparray(.columns.) + 
Pediatrix s wainie=d |“choices(.init.)+columns, next.) ; 
end; (* erase i 
Seenasor Loops. ~) 


writeln; 
end; 
(* end of loop2 *) 

aS ee ~~~ --— - Oe 

te CPR ee Se ea a rs 

enc: 

(* end of loopl *) 
end; 
AK sess ststssssst tts ses eee Xx 
=== Procedure Do Goodness Measure === ‘i 


procedure Goodnessmeasure(numfactor:integer; possiblestates:integer; 
Seaciae bik: Stacemdctr ix; 
var goodmatrix:goodnessmatrix) ; 


var | 
index, . 
ideal, antl : integer; 
cee 
max, min ; real; 
* ee eee eer Oc fees fees ce {ces cms came mms ES) mes Scere somes coeen ce mes eee cee fees eco kc ae cence es se ene * 
r === Procedure Print Goodness Matrix === * 
cients oa onan aes oe on a on on oo oe Le SS SS SS SS SS Se eS CK 


procedure printgoodmatrix; 
Genst 
one = 1; 


47 


14: 


EWOme ce 
four= 4; 
eight=8; 
var 
loops 
_ Ow Col enaimeicie as. 
begin 
page; 
Wrlteti. 
WeEce int! Goodness Measurements a 
Wiese LAK 
writeln; 
writeln; 
write Mi a 
Wete line ry; 
write , State Combination '); 
writeln(' ':(numfactor-two)*eight+four, 'Goodness Remarks'); 
hd werk Zt de) ee 
for loop := one to numfactor do 
write('val',loop:1,' ':4); writedn@ aime 
write ap 
writeln('! ry. 


for row := one to possiblestates do 


begin 
Cae eee 
WEelte(* "29: 
for Col := one to numfactor do 
write( statmatrix(.row.).column(.col.) = 6 )27muee 
WELLES (GOocmalrix(..6Ou.)0 2 622, wie 
if row = ideal then write(’ ‘4:5, ‘ideale 
else if row = anti then write(' ':5, 'anti-ideal'); 
writeln; 
emer, 
WEPre ta | oe) 


end; 


(7 Procedure beGitves>) 


begin 
Max == (99295 ihe ge 
Eou Index :— One to pessipiles tates arce 
eGan 


Case numfactor of 
2 : writein("* Nee prepared). 
3 : begin 
temp := -(statmatrix(.index.).column(.one.) ) 
+(statma trix (nee ese ed ae 
rete ex.).column(.threesje 
goodmatrix(.index.) := temp; 
1f temp > max then 


begin 
max := temp; ideal := index; 
end; 
if temp < min then 
begin 
min := temp; anti := index; 
end; 
end; 
4 : writeln('* Not prepared *'); 
end; (* end case *) 
end; (* end for *) 
Printgoodmatrix; 
end; 
bs == Procedure Get Benfit Matrix == es 


procedure getbenematrix(possiblestates:integer; 
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choices:choicetable; 

tranmatrix:transitiontable; 

oodmatrix:goodnessmatrix; 
var benematrix:benefittable); 


var 
Gow mic ljmtooD : integer; 
emo mene dL 


begin 
" for row := one to possiblestates do (* loopl *) 
for col := one to choices(.row.) do (* loop2 *) 
begin 
temp := OQ; 
£Ommloopm@e:= One to possiblestates do  (* loop3 *) 
temp := temp+(tranmatrix(.(row-1)*choices(.row.)+col, loop.) 
*(goodmatrix(.loop.) - eo neta. row.) )); 
benematrix(.row wei := temp; 
(x end of loop3 *) 
end: 
(2eencd ea: looo2 ~} 
(-sendeof lloopl *) 
end; 
* == SSS S222 2222525255555 5555555555525 252552555 =— * 
== Procedure Print Benefit Matrix == %* 


procedure printbenematrix(possiblestates:integer; maxcho:integer; . 
choices:choicetable; benematrix:benefittable) ; 


var . 
acu wmcor sinteger;: 
begin 
age: 
ee tein ' 347); 
writeln('Benefit Matrix! :47 
pritelin(’ ial; 
writeln; 
writeln; 
write ('State Z(i) Ye 
BeGecOl := One to maxcho do 
iomeerere!  colel !)y' § 's10)s 
writeln; 
write (' a 
Pere ln( ' ye 
for row := one to possiblestates do (* loopl *) 
begin 
write(row:4); 
Meco. one tO clioices(.row.) do (* loopd *) 
write(benematrix(.row,col.):14:6); 
(7 eneawet LoopZd ~*) 
writeln; 
end; 
(x end of loopi *) 
write saaNits 


weaceln(' iy 


end; 


(*x* PART II. MAIN PROGRAM ***) 
begin 


=== === In ut Data via Terminal ======= *) 


geotep 1. 
Getnumoffactor (numfactor,possiblestates,scales) ; 
Getnumofchoices(numfactor,possiblestates,choices,maxcho);. 
Getestprob numfactor,maxcho,scales,scalevals,estmatrix); 

bs S======= Get Transition Matrix ========= *) 

Pe Siee) lee 
Getstatmatrix(numfactor,possiblestates,scales,scalevals,statmatrix) ; 
printstatmatrix(numfactor,possiblestates,statmatrix) ; 
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printhelpfile (numfactor,possiblestates,statmatrix) ; 
(A sitep 1 Tae . | 
Gettranmatrix(numfactor,possiblestates,choices,scales,scalevals, 


. estmatrix,statmatrix, tranmatrix) ; 
Printtranmatrix(possiblestates,choices,tranmatr1x) ; 


b s2s2===2= Get Benefit Matrix =======-— *) 
* Step Iv. *) 


Goodnessmeasure(numfactor,possiblestates,statmatrix,goodmatrix) ; 


Coe S tem vse . 
Getbenematrix (possiblestates,choices,tranmatrix, 


goodmatrix, benematrix); 


siete hear 0 eee le ca bo) 0) CIICPMeLICI/SEHCTN EI 1 
enc 
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UPRIMA RAR SAAR RAMA 
+H# Peay PART eles tH# 
#34 Generate Long Run Polic 4 


= 
##4% This part processes howard's Beareenn HFH 
### main modules are pynenre formulation, ### 
### Resolve variable, and Setnewaction ### 
HHPUPPEPHHEEEHEEEEH EEE EEHU EHH HH HH oe 


AAA Ht A 
eo A A Oo OF OF 


KREKKKKAKAKKKKKAKRKKKKKKKAKKKKRKKRKRKKRKRRKAKKKRKRRKRRKARKAKRK 


RRAKK GET CHOICE POLICY KKK KK 
KAEKKKEKKKKKKKKERARKRKKRRKKRKRKRRKRRKRKRRRKKRERKKRKKERRRKGE 
Procedure Getchoice(possiblestates:integer; choices:choicetable; 
tranmatrix:transitiontable; | 
benematrix:benefittable: var policy:policytable) ; 


type 
markovtable = array eee ree OMeaamaxstaceetc.) Of real; 
determinval = array (.cne..maxstateetc.) of real; 
var 
index ence eu. 
je : integer; 
maxincome : real; 
markov | : markovtable; 
HesoLUE LOR : determinval; 
newpolicy : policytable; 
reached, matched, 
qultnow, inforced : boolean; 
* Se * 
* == PROCEDURE Initialize policy Table == * 


ececdure ifiittaleze(possiblestatés:integer; choices:choicetable; 
benematrix:benerittable; var policy:policytable) ; 


var 
row, col”: integer: 
Mac ened 
begin 
for row := one to possiblestates do 
begin 
max := ~999; 
for col := one to Gnoilces< .row. ) do 
If benematrix(.row,col.) > max then 
egin 
max := benematrix(.row,col.); 
por Te row.) := col; 
en 
end; 
end; 
* sae eee eee eS SSS SS SS SoS oS oo * 
* == PROCEDURE Dynamic Formulation == ‘i 


procedure dynamic_formulation(vi:integer; possiblestates:integer; 
choices:choicetable; tranmatrix:transitiontable; 
benematrix:benefittable; policy:policytable; 
var markov:markovtable) ; 


var 
Macinecol : Inceger; 
begin 


x fill matrix with variable coefficient *) 
Or row := one to possiblestates do 
markov(.row,one.) := 1.0; 
for row := one to possiblestates do 
For col := one to possiblestates do 
If row = col then 
markov(.row,col+l.) := 
: 1- (tranmatrix(. icon i enedces (azo. )+policy(.row.),col.)) 
else 


S| 


mar key ee ae := 

-(tranmatrix(.(row-1)*choices(.row. )+policy( .rows)coummmm 

for row := one to possiblestates do 
markov(.row,possiblestates+2.) := benematrix(.row,policy(.row.).); 


(* remove an arbitary vatiable v(i) *) 


for row := one to possiblestates do 
for col := vi + one to possiblestates + one do 
markov(.row,col.) := markov(.row,col+l.); 
end; 
A sss. ce SSS SSS SS SSS SS SSS SS SS i a a nl 
* == PROCEDURE Resolve all variables = , 


procedure Resolvevariable(vi:integer; n:integer; 
var markov:markovtable; 
var resolution:determinval) ; 


var . 
Silas integer; 
multfac, 
_ temp ea. 
begin, ere 
AAKARAKKA manipulate markov matrix ****KAARAKRA) 
£0% 1 2=.1, tO n=) do Begin 
If Mageov (si; 1.) <2 2) nen 
begin | 
multfac := 1/(markov(.i,i.)); 
fOr 2= 1 to it eads . 
‘ markov(.i,j.) := markov(.ij,j3) = mob etace 
eng: 
fOr 3 t= a). fou meco 
begin 
mubeiac <= maykov si) 1.) : 
fOr Kk <= 2 Co n+i co 
Z markov(.j,k.) := markov(.j,k.) - (multfac * markov( {gee 
end; 
end; 
(AAARAKAAK find SOluti6on KREEEKKAERKKKK 
resolution(.n.) := markov(.n,ntl.)/markov(.n,n.); 
fOr 4 j= 1-1 decwnco leae 
begin 
Cenp..:= 0; 
for) := it) to tn=de 
temp := temp + | 
cma OY eae x resolutioni@mm))- 
resoiution(.i.) := markov(.z1,nfl.) = temp, 
AIR RRR IK ARTI R IIIA II IRR II IIR IKARIA IIIS II III AIA 
por j) c= mW Covwmeo Vl alae 
resolution( .j+l.) *= resolution eer 
resolucion( .vith.) <0: 
end; 
* San an an = an an = on a. = an ann ——_ << — = =< — * 
* == PROCEDURE Set New Action ay 
Qo SecccccccccccSsccScS SSS Se SeScsSccS SS SSS sSssSsS SSS cS SSS eee >> ae 


procecure setnewaction(possiblestates:integer; choices:choicetable; 
tranmatrix:transitiontable; 
benematrix:benefittable; . 
resolution:determinval; var newpolicy:policytable; 
policy:policytable); 


type 
eval_property = record 
Per ge tieegens 
val : real; 
end; 
var 


Can 
yee 


eol, cho, loop, 
i, ik; selectcode: integer; 
temp, He »max: real; 


property : array (.one..maxchoice.) of eval_property; 
begin 
roe loop := one to possiblestates do 
begin 
Mana ooo) 
for cho := one to choices(.loop.) do 
begin 
dynamic := 
for col := one to possiblestates do begin 


dynamic:=dynamic + 
(cranmatrix(. Gloep—-1)-cnoices(.loop.)+cho,col.) * 
7 resolution(.coltone. We 
en 
dynamic:=dynamic + benematrix(.loop,cho.) ; 
property (. selgte)e i: ‘oer <= Cho; 


roperty(.cho.).val := dynamic; 
eee iG end of choice * ) 


v sorting * 
or i := choices(.loop.) downto two do 
BOn = OnewLo 1-1 edo 


if properiaviG@aees val > EOP Caey ( - j.).val then begin 
temp := property(.j. al; 


cremate ai. 2 .val property/(. eevee dl; 


me 


ropert y er yer 
= property( 3 : 
property} Bee ros3= property (. ioe per: 
property ptr := end; 


fa equality = 
Pest property (.1. ): val >= 0) and (property(.2.).val >= 0) then 
selectcode := 1; 


Te (property (. 1.).val >= 0) and (property(.2.).val < 0) then 
selectcode := 2; 

tiecproperty«.1.).val <0) then 
selectcode := 3; 


case selectcode of 
eae COO et (ak ea .val- FR ofa ec, )s/ 
va 


property (; ) <= 0.0001 then (* identity *) 
newpolic logos = On levi. oe 
else neupericyt, loop: = proper y(.l eae 
Z2 : newpolicy(.1 sroperty( eet) tr; (* nonidentity *) 
Salt Gseeerey Co ); .va i Brey. = ba ae val 
property ( Vavaly > 00001 ce (x aa cOeeeneErey x) 
newpolic . Loop = Bese eek 
else Tice ace 7 = policy ( oop. 
end; ae end of loop *) 
end; 
(*xk*k PART III MAIN PROGRAM *xx) 
begin | 
V1 := possiblestates; 
hepeat 
es ease x) 
Hatta ize(possiblestates, choices,benematrix,policy) ; 
maxincome := -999.0; 
inforced := false; 
BeDealt 


fiaeoeep Ii... *} 
Dynamic_formulation(vi,possiblestates,choices, 

tranmatrix, benematrix, policy, markov); 
step Ills *) 


Resolvevariable(vi, ossiblestates,markov,resolution) ; 

for i := 1 to possiblestates + 1 do 

(oarsteo 1. -* 
setnewaction(possiblestates,choices,tranmatrix,benematrix, 


a5 


resolution,newpolicy,policy); 


Gui (now =e bauer . 
1f maxincome <= resolution(.one.) then 
begin 
index := 0; 
quitnow := true; 
repede 
index := index + l; 
reached := ee >= possiblestates); | 
matched := (policy(.index.)=newpolicy(.index.)); 
quitnow := quitnow and matched; 
policy(.index.) := newpolicy(.index.); 
Until ewedcned: 
ave ee ane (resolution(.one.) < 0) then inforced := true 
, else maxincome := resolution(.one.); 
en 
else inforced := true; (*endif maxineome~) 
Unea! HON or inforced); 
Vi := vi-l; 
if (vi = 0) and (not quitnow) then writeuser( IMPOSSIBLE) ; 


until ((quitnow and (not inforced)) or (vi=0)); 


f 


Vai o> Vil oe ee . 
aoe := resolution(.one.); (*printed on policytable*) 
enc: 


a 
-_ 


ea. ————— 


: a Lee RNa nan CEES eH nh ae eS TE ‘i 
woes 6G (CUM PART IV. ### * 
x fH Hud x 
K PHPHHHHHEHEPHHEE PEER HEHE AEEHHEHHHHHS SHH OX 


REEKKKKKRAKRKKAEKKERRKRRAEKEKRKARRKRRRRRRARKAKARARKRRRRRARRRR 
RRR iy T E Seas G © 1 O°N RRR 
REEKKAKKKKEKRAK ARK RKRRKRKRRRKRRARRRKRRRRRARKAKRRKRRARRK 


Procedure interaction(possiblestates:integer; policy:policytable) ; 


ype 

elementtable = array(.one..maxfactor.) of real; 

oneline = packed array(.one..seventy.) of char; 
var . 

GULReNre «tne Qer - 

SHEVII SS 5 Ele tetsle celle) Wer 

ine ; oneline; 
yesno : Char; 


doall, nomore, 
needhelp : boolean; 


* —— ee eee eee ee ee ae ee awe ee eae ae ee ae ee ee nie ae eee eee eee * 
i == Do Partial Decision policy == is 


procedure dopartial(possiblestates:integer; policy:policytable); 


begin 
writeln('Do you want to see Helpfile for current problem ? y/n'); 
Reena (vesno). 
scone tp := (yesno='Y') or (yesno='y'); 
Beeneednielp tEnen begin 
reset (helpfile, 'helpfile data'); 
while not eof(helpfile) do begin 
readlin(helpfile, line); 
pee end; 
ena: 


mepedt 
writeln('What is your current state ? ===> Type n'); 
readin(current) ; 
until (current > 0) and (current <= possiblestates) ; 
writeln; 


write ieee Stabemw: ) 8 ecurrent:2, "| ie 
Meerciniisest Choice : ', policy(.current.):2); 
writeln; 

end; 

* sams amc ania cr saat cee cst cms cs secs (cer ses] asc cms sia an ( (ce cm cma Canc oee se cars, Cam om ca (oe i) ees cmeaa * 

f == PRN POLLCY 7 [TABbLe == : 


procedure printpolicy(possiblestates:integer; policy:policytable) ; 


“stg 

meroop, cnt : integer; 
begin 

page; 
mea te ln | a) 
writeln('Decision Choices! :27); 
meaate ln ( | 0); 
fie e ln; 
fice in; 
writeln('State Cnetcesrolicy’ ); 
paeateln(!Z(i) C(k) oe 
writein De 
fete ln; 
cnt := QO; 
for loop := one to possiblestates do (eeiocop2 *~)} 

begin 

Weiteln looo:4." "2:30, policy(.loop.):3); 


‘ 


ca 


5 


Cnt := cnt ee 
ae (cnt mod 3) = 0 then readln({wait); 
ene 


writeln(' e 
Wi ee ny 

writeln('set arbitary vl, vi:2, come ee 

Vite lm 
writeln('maxincome per period : ', gain); 

writeln; 


ena 
erlcr 


begin 
repeat 


( 


pace, : i 

TELeoInC IB ou want all decision policy ? y/n'); 

reanln Senne 

doall := (yesno='Y') or (yesno='y'); 

if doall then printpolicy(possibléstates pouuey® 
else dopartial(possiblestates,policy); 


writeln('Do you have another ploblem ?'); 
rencih eenose 
nomore := (yesno='N') or (yesno='n'); 


until nomore; 
end: 
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K HHHHAHHHRS AHA HRR ARRAS HARARE SHEER RR RSE RH 
* #37 HHH 


* 
* 
x ### GC OM oe V. #4 * 
x #44 Exit Garbage Can HH * 
X HHRHRHRHR ARH HHH R SS pares RHHHHHHHHE 


SN GET BOOLEAN VALUE at 
KAKKKAKAKAK ARK KK AKA KARKR RAR AKA KARKARKARRAKRKKRKR 


Procedure Getboolean(var Exit:boolean) ; 
begin 
Kit := true; 


Be 
eng: 


vere, End, of Garbage can, Model Program | **} 


Cea Ean Eee aes tee aunenen rant 


AKK End of Garbage Can Model Proaram ARK 
ee ee ee RAKE 


AKKKK MA PROGRAM AKKKK 


KRAEKKKKKKEKKKKKKRKRKKEKRKKKKKKRKRKRKAKKRKKRKRKRKRKRKKKKKKKERKK 
IE 
KEKKKKRRKRKRKKKKKKKKKKKKARKAKRRKAKKKKAKRKKKKKKKK 


begin 
Quitnow := false; 
While not quitnow do begin 
if getcommand(command) then 
Case command of 


EXECGCM : begin 
Getmatrix(vossiblestates,choices, 
tranmatrix, benematrix); 
Getchoice(possiblestates, choices, 
tranmatrix, benematrix, DOLLcy)- 
Interaction(possiblestates, policy); 


end; 
EXECEXIT : Getboolean(Quitnow) ; 
end 
else Writeuser(BADLINE) ; 
end; 


end. 


> 


APPENDIX B 
USER MANUAL 


PEGE rogram, =. 67 


I. PROGRAM NAME : pgcmprog (written in Waterloo pascal language) 

II. PURPOSE : Get a set of choices available in a specific organization 
problem 

Lit. fOeuss: 


1. Before Execution 


Formulate problem and set alternative actions 
Turn on your terminal 

LOGIN userid 

ENTER PASSWORD(IT WILL NOT APPEAR WHEN TYPED): 
Memory extention (if necessary) 

: DEF STOR 1500k 

7 CMS 

6) Execute garbage can program 

: pw gcmpreg pascal 


2. During Execution 


1) Select menu option 
Sinai = Bxeccen 
cecees EXiLtGCMH 
2) Enter number of scale points for each factor 
i,e> factor hx .3 
factor 2. : 2 
factor 3; Z 
======> possible states :3 x2x2=:=12 
4) Enter number of choices for each state 
1.e> state 1 ? 2 
state 
state 
state 
state 
state 
state 
state 
state 
state 
state : 
State laa 
======> maxchoices : 3 
4) Enter estimation probabilities 
if user has the following input data, 


On. GO) ROF 
hor 


SN ee ND ON We eV 


OOOO Wh 


te 
© 
“Nv 


te 
re 
Nv 
WWW WWNINW WW WN 




















factorl(P) factor2(s) factor 
P 5 

Ghoe! 00 CO a56be0 Che | 0-0-4120 Che | O40 eae 
i: O22 Gaza 0 4S l | Of 0G i | 0.350 ae 
1 O- 3) Geo (G45 1 OF 90-4 1 0.7 0.4 
a. 0 Se Oy eGeez 

ane OMOTG25— 1.0 Ehe | O20 740 cho | 0.0 Aye 
Z | OIF 2S OR7 2 | O25 20a 2 | OG. 2 Ge 
2 G2 5350.50 ae Ps 0. 520n2 2 0.8040 
Z | O40 ee 0 ce 

cho | C2 0202 Sao cho | O-20aae cho | 0. 0516 

Sol oc 3 | nOsomone an | ORO 


3 0. 


tO 203 See O20. 7 om 0.6 0.5 
3 OFS Onl 20 


Ses, 


Interact with the folowing manner 


(factor!) . 
ieee seater i) = 90.00 “Choice C(1) 
Terminal State 

probl BroD2Z BEebsi? 


OZ oe 0; 


rectangle : Hele bus data 


Mpbera lees taceer | b) = 9 0.50. Choice C(1) 
Terminal State 
probi prob2 DrObs =? 


0.4 OF OnE 
[Tnptialeestate £(1) = 0-10 Choice C(1) 


Terminal State 
probl PmOpZ “probs. ? 


ee O. OZ 


(Eactou2) 


oe ¢€e¢e#¢e%e8¢¢6ee¢e¢e¢¢8¢8 68686846 @ 6 @ @ 
#®*e%see%e%eeee##%8¢*##8¢¢6#8###8¢e##¢#86 8 ¢€ 


*ee%en0n6e#e5ne#efee#e#e#%e%eee?¢e«#g%e#se##s#se#seste* @ 
e*e-+enejeose#etse%e%eeg#er5nje%eee#tte#ste#e#ees* ¢ ¢ @ 


*eee%#8##¢#@e¢e¢ee¢e¢#e¢e¢¢¢#8¢6¢908 6 6 ¢ 


* choice 2 and choice 3 operations are the same 


3. After Execution 


1) Do you want all decision policy ? y/n 

yes 
~ display all choice policies 
no 


Do you want to see Helpfile for current problem ? y/n 


yes 
' display organizational states for nee ey aids 
Wha - your current state ? ===> Type n 

no 
What 1s your current state ? ===> Type n 


2) Do you have another ploblem ? 
yes 


COMO] Dp rOceauie ys a! 
no 


GGmeo PEOcealre 2.1 
4. Get results 


1) PRINT OUT = Se 
thi Genprog Listing 


oo 


2) BROWSE 
eon 
: use PF key 


Sy rn wGus 
: LOGOFF 


60 


We 


P 5 

eace 0.00 5G 00 0200 O56 F200 e007 cl; 
i 0.98 0.19 O70 1 0.97 Ons Or G0) 0.95 0 

OAC 0.80 O20Z O= 02 On LO O20) 205.000. 
i. OrcOF O20) 0.97 O...0.) 0.29 O296 
ie 0.98 0270 Oo. G-20 OO Oo) OOS) (0) 
Zz O76) 0.29 0250 Ory © Oo OO Oso) 8 
7 O70) O01 0.40 GieO 60 0.98 
3 0.98 OFC 0 0.39 0.90 0:01: O201 on Oca 
eB Orne. Ong O2e0 0.09 0.39 0-01 O30 350 


APPENDIX C 
OFFENSIVE OPERATION EXAMPLE 


KAKAKKKKKKKRKKKKKRKKKKKKAKKKKAKKKAKKKK 
AX AX 


Peo cco eee User wainteraction ** 
aX AX 


KAKRAAKKKKKKKKKKRKKKKRRKKKKKAKKKAKKAKKER 


Formulate problem and prepare estimation probabilities 


P : Importance or problems to be solved 
pee coaec Or €rtectaveness in problem=solving 
Eeoerotential energy Of Participants 


pl=0 No significant problem regarding attack forces, 
Mission 10ad, Weather = relation with consequent 
Midicary Operation 


p2=.5 Moderate shortage of attacking forces, not qood 
weapon system good weather, a certain time delay 
to the consequent operation 


Be=) Acute Shortage of attacking forces, big mission 
Had bag wedceherm, a5 ekemendeus time delay to the 
consequent operation 


S1=0 Most of personnel have no experience in the battle 
field, poor coordination with adjacent ase 
poor performance weapon systems 


a2 yo oome  peusonne. have! dan experience in the battle 
fiel appropriate coordination and _ reasonable 
attack-defense forces hati, good performance 
weapon systems, good logistic support systems 


pe-l Some personnel have an experience in the battle 
icine sccm lemescOOnGinatton, best attack-cdefense 
DoRecesmodelonmence lent perrtormdnee weapon systems 
, sufficient logistic support systems 


El1=0 Not quite proud of their operations,passive action 
E2=1 High morale, high responsibility 


00 


yon 


a9 


Baal 
oo 


a0e 
ee. 


4 0.30 Ome O20 0530 G20 0530 0.20 30no 
~ O60 0.80 Gn ae 0).60 0.60 0.40 0.60 0ree 
* 0.10 ene Onrz0 OTTO O20 UF30 


II. Execution 


Select Menu Option 
1. ExecGCM pexeeee GCM pa 
2. EX€CEXIt(BxXecutionescoo 


Enter # of scale points for each factor 





Factor |: 3 

FACtGr. 2: 3 

factor 3S = 2 . 

goahead : Press any key, correction : "%'' 


i 
[- 
ame 
Oo 


Get Number of Choices for each State Z(1) 1 


State Z(1 orf choices 


if 


OW ~)0O1,On DP WHF 


Fo 


OO epee uu eu eu ou 


4 
4 
+ 
4 
+ 
4 
+ 
+ 
4 
+ 
4 
4 
& 
4 
+ 
4 
4 
co 


goahead : Press any key, rrection 2!) 
Get Estimation Probabilities 


(factor! } 


Initial State £(1) = VO300 Cherce ee a 
Terminal State : 

prebl prop2 probs ¢ ‘0.98 0-12 0esu 
Initial State £(1) =. 0.50  ~Ghercesea, 
Terminal State : 

Drool. prop2Z props) - GO. 0r Once me 
Initial State f(1l) = 1.00 Choicewei 
Terminal State : 

probl ‘OrobZ) props + §0.0l 0-0 lc 


(x Display Input Data *) 
C706 (ese 1.00 


1 Geese. 19 Oren 
l Onor pec0 O202 
l Onor oO) 0.97 
goahead : Press any key, correction cae 


eeeee#ee#ee# @#eee#%#e8ee8e8 8 @ @# @#¢#@e@eeee#e«## @# @#e # @ @# @# e # @# @© @# 


eeee%eete«goeneeee%ee#se#ee@e##e%e#eeee%e#e#@#%#*#%*e#e@e@e@ee8e@e¢@e@6m8t6mUmhmUOhmUCUMOmmUCUCUOhmUCUC mC HMmUCUC UOC 


@eeeee#tee#snee#ee#e#eee##e#eee#eee8#e8#ee8@8 @e@mUmhmUCUcOmhUhCUChmhUCUcM PMhCUCUcrOmhUCUcMOmhUCUcMOmhUCUc MmhUCUc OhUlCUchFhUCUrhhUhHMhUhOhlh! 
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KRAKRKARAKKKAKRKKRRKRKRRRKRKKRRKRRRKRARKRRRRREA 
AK AX 


xk Step II : Generate Matrices ** 
AX KK 


RRREEKRKKKKEKRRRRARKAARRKKRRRKRKAARKRKERKRE 


Sr re eT RT tae a eee cn STS a SO ee 
Transition Maer. 


intvtial Stave -a cael 


state Crr eZ ECs C¢(4 
1 0 -903070 0.039200 0.617400 O 0 LE00G 
2 O.. 047 530 0.156800 0.264600 0.072000 
3 02015620 ets 7200 0.061740 0.036000 
4 0.000980 0.548800 0.026460 0.144000 
5 0.009310 0.019600 0.006860 0.006000 
o 0.000490 0.078400 0.002940 0.024000 
7 O 7009215 0.000400 0.006300 0.035000 
8 0.000485 0.001600 OF O27 eo) 0.144000 
7 0.000190 0.001400 O,OUGGE3o 0.07 2006 
10 0, OC COL 0.005600 O-000Z7¢0 0.288000 
el 0.000095 OT COeZ00 0; 000070 0 “612000 
V2 0.000005 0.000800 OF; G000s0 0.048000 
E3 O,0039Z715 0.000400 0.006390 0.006000 
14 0.000485 0.001600 0; 002700 0.024000 
ES 0.000190 0.001400 0.000630 0 OmZ000 
16 O.. OO0010 0 005600 0.000270 0.048000 
Lz. 0, 000095 0.000200 0. 0000706 O00 Z000 
18 0.000005 0.000800 0.000030 0.008000 
Initial State =-Z 2 
state Cel CZ GCs C(4 
1 0.002506 0.001960 0.044100 0.027000 
2 0.941094 0.194040 02687900 0.063000 
Ss 0.000196 0.906860 0.004410 0.054000 
4 0.019404 0.679140 O02. 0es7 90 0.126000 
5 0.000098 0.000980 0.000490 0.009000 
6 O200S7 pz 020979020 O. 009370 0,0 Z 000 
7 0.000097 0.000020 0.000450 0.054000 
8 0.009603 O20013e60 0, 006550 0.126000 
9 O'- 00G00Z2 O2000G70 0.000045 0.108000 
10 0.000198 0.006930 0.000655 0; 252006 
it 0-000001 O.000010 O.@00005 0.018000 
12 0.000099 0.000990 0.000095 0.042000 
les 0.000097 0.000020 0.000450 0.009000 
14 0.009603 0.001980 0.006550 0.021000 
rs 0. 000002 0.000070 0.000045 O -OLE000 
ie) 0.000198 0.006930 0: 00@655 0.042000 
iy 0.000001 U-0CCO20 O.00G005 0 -003000 
18 0.000099 0.000990 0.000095 0.007000 
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Bameiat State =: Z 


state 


OnAOONPWNHrODOUHKMHBWNHFE 


MRR RRR Ree 


O@OCOoaO OOO oeoaooeae eG 


ec 


2009310 
.000490 
os. 7 00 
.034300 
WZo79 50 
.014210 
.000095 
-Q00005 
.006650 
ROO S50 
mOw2 7 55 
.000145 
wOOU09S 
.000005 
.006650 
Ow 50 
mOUZ7 55 
.000145 


Initial State : Z 


Sbace 


OOn~AMPWNH- 


ODDDODVDDDVDDOOCOCOOCOCCOO 


e¢l 


000098 
mow gy Oz 
.006860 
me? 2140 
-002842 
Zoo ° 
-Q00001 
-000099 
-000070 
7006 730 
eegOOZs 
soOZS7 1 
PeOGOOL 
.000099 
.000070 
7006930 
-OOU0Z9 
soozord 


3 


4 


COOQOODCOODOOSGeaoeoqgceoaoe 


OQ@QQ@QOQOQ@QOo Cooeco0o0oo 


CZ 


UOT 260 
.007840 
nOSTea0 
. 148960 
roo SeO 
oe CUO 
.000020 
.000080 
5VO0Se0 
HOO loz e 
-001600 
.006400 
e000 Z0 
.000080 
.000389 
BOMnESZ 0 
5 lO ee 
.006400 


Ce 


-000098 
~V097 02 
.001862 
LOaS5s6 
.007840 
nL o160 
.000001 
TUOOOs9 
FOOUOTS 
wHOLSS 1 
.000080 
OUI 20 
.O00001 
mHeOeWI9 
.000019 
yUGeoo 1 
»000080 
noo? 320 
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OOCOOVQOOOCOoaooeoooegaG 


DOODDADGBDOGODABDDDVODOOO0C0O 


eS 


.006860 
.002940 
- 267540 
.114660 
~411600 
.176400 
.000070 
-000030 
otZ7 30 
OO L 70 
-004200 
.001800 
.000070 
-000030 
OwzZ 130 
POOL 7 0 
.004200 
.001800 


Cie 


.000490 
20093 10 
2019110 
O50 G0 
-029400 
-558600 
“080005 
-000095 
sow 5 
OCs 705 
,80O3S00 
p00s700 
sUOGU0S 
POWOOss 
FOOO195 
sega 705 
OOo s C0 
“005700 


QOoOeGoCcQOoGOIeceaoGoaqoqgneGg 


GSeQoqgeQecqeQaogoaouoaoeaooeaG 


C(4 


( CArele, 
.048000 
.036000 
. 144000 
-012000 
.048000 
~024000 
.096000 
SOOO O 
- 288000 
~024000 
-096000 
-0040C0 
-016000 
-012000 
-048000 
-004000 
.016000 


C(4 


.018000 
~042000 
.054000 
» 126000 
-018000 
.042000 
-036000 
.084000 
108000 
eZ 
Tso 000 
.084000 
.006000 
~014000 
HOLSUDe 
-042000 
.006000 
.014000 


Initial. states 2 


Ce Elz GS C(4 
l 0.009310 0.001960 0.006860 0.018000 
Z 0.000490 0.007840 0.002940 07072000 
3 0.009310 0.001960 0.006860 0.024000 
4 0.000490 0.007840 0.002940 0.096000 
5 0.912380 0.192080 0.672280 0.018000 
6 0.048020 O02 /o38320 Oyzeerze 0.072000 
7 0.000095 0.000020 Gg, 000070 0.036000 
8 O20000e5 0.000080 07000030 0.144000 
9 0.000095 O20000Z20 O7.000070 0.048000 
10 0.000005 0.000080 0.000030 0.132000 
11 0.009310 0.001960 0.006860 0.036000 
12 0.000490 0.007840 0.002940 0.144000 
AS 0.000095 ORO O007Z0 0.000070 0.006000 
14 0.000005 0.000080 0.000030 0.024000 
15 0.090095 0.000020 0.000070 0.008000 
16 0.000005 0.000080 0.000030 0.032000 
17 O2003310 0.001960 0.006860 0.006000 
18 0.000490 0.007840 0.002940 0.024000 
Initial State :Z 6 
state ere Ci Ct3 C(4 
1 Q.000098 0.000098 0.000490 07027000 
Z OF,00S 702 0.009702 0.009310 0.063000 
3 0.009098 0.000098 0.000490 0.036000 
4 0.009702 0.009702 0.009310 0.084000 
5 0.009604 0.009604 0.048020 0.027000 
6 OF S50796 0950796 OF 912580 0. 063000 
7 0.000001 0.000001 0.000005 0.054000 
8 0.000099 0.000099 O-eo0003s 0.126000 
9 2000 OG Q0.Q00001 ORO COOs 03072000 
V@ 0.000099 0.000099 0.000095 0.168000 
11 0.000098 0.000098 0.000490 0.054000 
12 0.009702 07009702 0.009310 0.126000 
13 0.0C0001 0.000001 0.000005 0.009000 
14 0.000099 0.000099 0.000095 0.021000 
ES 0.000001 0000071 0.000005 C201 2000 
16 0.000099 0.000099 0.000095 0.028000 
tay, oO; COCoSs 0.000098 0.000490 0.009000 
18 2.009702 0.009702 0.009310 O07; 02Z1000 


fipeerwal State + Z 


7 


state cc ee GCs Gia 
i 0.175085 0.028000 0.504000 0.006000 
2 On0097215 0.112000 2 LeuCo 0.024000 
3 0.003610 0.098000 0.050400 O26 12000 
4 On000190 0.392000 O02 1600 0.048000 
5 0.001805 0.014000 0.005600 02002000 
6 0.000095 0.056000 0.002400 0.008000 
7 Oe 727200 0.011600 eo OO 0.048000 
8 O20 28800 0.046400 O7o5 1200 Ges 2000 
9 02015200 0.040600 0.011970 0.096000 
10 0.000800 0.162400 O7G05120 0.384000 
ial 0700 7500 ©. 005300 0.001330 0.016000 
EZ 0.009400 Oz ZZ200 Gewoo 570 0.064000 
13 02009215 0.000400 GeO 6300 0.006000 
14 Ono0e4ss 0.001600 0.002700 0.024000 
15 0.000190 0.001400 0.000630 O20 Lb 2000 
16 0.000010 0.005600 O2 000270 0.048000 
17 0.000095 G2 GO0Z200 O-000070 OL0GZ0CO 
18 Hee" s 0.000800 0.000030 0.008000 
mpcial State :Z 8 
state Gqi1 G2 ECs C(4 
i 0.001843 0.001400 0.036000 0.009000 
iz Ore 7457 0.138600 0.684000 0.021000 
5 ©.000038 0.004900 V2 003500 0.018000 
4 O.003762 U,4265100 0.068400 0.042000 
5 @-.0000L9 02000700 0.000400 Oo, 00s 000 
6 0.001881 0.069300 0.007600 0.007000 
7 0.007760 GnO00580 O00 3550 0.072000 
8 0.768240 02057470 0.162450 0.168000 
9 0.000160 OU Zo 0 0.000855 0.144000 
10 omo1so40 G-200970 0.016245 0.336000 
11 0.000080 0.000290 0.000095 0.024000 
12 0.007920 OeOzer lO O7oCwreos 0.056000 
3 0.000097 0.000020 Oro gg4 50 0.009000 
14 0.009603 0.001980 OnOGe550 OO Z 000 
nS 0.000002 0.000070 0.000045 0.018000 
16 0.000198 0.006930 0) (0/0) Ohsieyey 0.042000 
i] O- 000001 0.000010 0.000005 0.003000 
18 0.000099 0.000990 CVO 095 O00 7 000 


6/ 


Enitial. State =.2.29 


state CL GCZ Cis C(4 
i 0.001805 0.001400 0.005600 0.004000 
2 0.000095 0.005600 0.002400 0.016000 
S Ol 6so8 0.026600 0.218400 0.012000 
4 0.006650 0.106400 0.093600 0.048000 
S 02052545 Omi Z0 00 0.336000 0.004000 
6 OF O27 55 0.448000 0.144000 OT C1T6 000 
ei C200 7600 0; 000580 O5001330 0.032000 
8 0.000400 On COZ3Z20 0.000570 OVEZeo08 
9 02552000 OF 011020 OL0Siear0 0.096000 
10 0.028000 0.044080 0.022230 0.384000 
11 0.220400 0.046400 0.079800 0 032000 
12 0.011600 On e5600 0.034200 0.128000 
1S 0.000095 0.000020 0.000070 0.004000 
14 0.000005 0.000080 0.000030 0.016000 
ies O2e0Geso HeOUOsSSO Oz sO 0.012000 
16 GO. CU0S50 02001520 O= OGial7 0 0.048000 
La OrW0Z7 55 OF001T600 0.004200 0.004000 
18 0.000145 0.006400 ©, 007 s00 0). OL6000 


Ing tial State 232010 


state ci C(2 CKs C4 
I @:000019 0.000070 0.000400 0.006000 
Fa On00TSes i 07 006930 0.007600 0.014000 
3 05001330 0 001330 O01 S5600 0.018000 
+ OnVs16 0 Or Sse, © 0.296400 0.042000 
5 0.000551 OF 0058600 0.024000 0.006000 
6 0.054549 0.554400 0.456000 0.014000 
7 0.000080 OF 000029 O.0G 0095 0.048000 
8 05007920 02002371 ©, 007805 0.112000 
9 O-00ScG00 0.000551 0.003705 0.144000 
10 0.554400 0.054549 0.070395 0. cSo000 
ik Or0e 2320 0.002320 07005700 0.048000 
2 OF225660 On2 29650 OE MOS S106 Oj rZ000 
13 O200000) 0.000001 0.000005 0.006000 
14 0.600099 0.000099 0.000095 0.014000 
Ls 0.000070 OeCU00T9 O.0C01S5 0.018000 
16 0.006930 O.001TES1 03003705 0.042000 
17 0.000029 0.000080 0.000300 0.006000 
16 O;002Z871 02007920 02005700 0.014000 


interval State :- Z 1i 
CCl 


-001805 
sOv009S 
pOeleds 
7000095 
moo lO 
209510 
.007600 
-000400 
.007600 
-000400 
744800 
woo 7200 
.000095 
.000005 
NOOO I> 
.000005 
.009310 
.000490 


state 


OADMNAPWNHHO YDOWMHUNpWNEH 


Martial State : Z 12 
GiGl 


sOO0O019 
001881 
soO0019 
.001881 
001662 
184338 
-000080 
SOOT I20 
.000080 
2007920 
.007840 
OL o0 
~Q00001 
“OOO099 
~O00001 
~000099 
.000098 
FOOT OZ 


state 


OOO OOOO Cea ooeooagooege 


OOQOOQaQOOOOoa oc OO OO eoO 


OOO ODODOOOODDOOOOO00O 


OODOODOOU OD OOOOOOCOOCOOO 


Clz 


-001400 
.005600 
.001400 
.005600 
we 7 200 
- 548800 
nO DO 5260 
see Z3Z20 
.000580 
ROU ZSZ0 
.056840 
pezi sou 
~000020 
.000080 
-000020 
-000080 
OO LI60 
.007840 


Cr 


-000070 
7006930 
.000070 
.006930 
.006860 
-679140 
.000029 
002871 
.000029 
BOOZG) 1 
.002842 
ecels5o 
.000001 
nOOOO 3? 
.000001 
AOU 0I9 
-000098 
2009702 
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ODODDDOAODODDDODOOOOCOOO0O0O 


Cs 


005600 


.002400 
.005600 
.002400 
. 548800 
WeooZeO 
,001330 
-000570 
2OC1 S30 
s000570 
130340 
052000 
.000070 
.000030 
-000070 
.000030 
.006860 
~002940 


Ce 


.000400 
.007600 
-000400 
-007600 
10319200 
744800 
-000095 
2001605 
.000095 
~vd1305 
,00 3510 
oS oO 
.000005 
~Q000095 
-000005 
AVOOOI5 
.000490 
"003510 


QoQ oO OOO OOG eqooeoa ong o 


C(4 


006000 


.024000 
.008000 
soa 2000 
.006000 
-024000 
-048000 
222000 
.064000 
-256000 
.048000 
2192000 
.006000 
.024000 
.008000 
as z2000 
-006000 
.024000 


C(4 


5007000 
-021000 
F022 000 
.028000 
2009000 
-021000 
2072000 
. 168000 
70 20000 
-224000 
wi 2000 
. 168000 
.009000 
.021000 
.012000 
-028000 
.009000 
FO 21000 


Phvtiare state =2415 


state Cl CZ Es C(4 
1 O-009Z15 0.004000 0.245700 OFCFZGCa 
Z 0.000485 0.016000 0.105300 0.048000 
3 0.000190 0.014000 0.024570 0.024000 
4 0.000010 0.056000 C2 OTOSs0 0.096000 
2 0.000095 0.002000 0.002730 0.004000 
6 0.000005 0.008000 CeoG 7c 0.016000 
a 0.018430 0.020000 0.378000 0.036000 
8 0.000970 0.080000 G. leZzcoo 0.144000 
2 0.000380 0.070000 0.037800 OZ07 2006 
10 0.000020 Oe V000 OC 70lEZ00 0.288000 
De G2eCols0 GSOTeouc 0.004200 0.012000 
eZ 0.000010 0.040000 0.001800 0.048000 
Is Or ecoo oo 0.016000 0.006300 0.012000 
14 0.047045 0.064000 0.002700 0.048000 
i 0.018430 0.056000 0.000630 0.024000 
ie G2C00s70 0.224000 0.000270 O-CI60U0 
1 GO. 003215 0.008000 0.000070 0.004000 
18 0.000485 Ge0SZ000 CRCeCese 0.016000 


Tnitial State : Z 14 


state Cel GXZ Ges C(4 
iL OR GOO097 .000200 Onomro 50 .018000 
2 O00 3 joe oo0 0.333450 -042000 
3 0.CO00002 .000700 CeO 55 -036000 
: GaCeCl ss oo 5 00 05033545 -084000 
5 0.000001 -000100 0.000195 -006000 
6 O20C0099 sO I900 OFC03705 -014000 
ao 0.000194 soe LUGO 0.027000 -054000 
8 O20LIZ06 -O97000 Oe ole 000 126000 
9 0.000004 AOS SOU 0 COZ 7/00 . 108000 
10 0.000356 - 346500 02028300 ~ 252000 
Te CZOOCOUZ HOE SOO 0.000300 -018000 
bZ 0.000198 ~049500 @3005700 .042000 
13 0.009409 -000800 0.000450 -018000 
14 Geos teol ney OO C2 00s 550 -042000 
iS 0.000194 .002800 0.000045 .036000 
16 Cryer 206 2277200 0.000655 .084000 
ey Cnwo005 / -000400 0.000005 -006000 
18 GC O0I603 nS 7000 OCG 0075 .014000 


iimeial State <9Z 15 


state Eci Be2 x3 C(4 
1 0.000095 0.000200 OOO 27 30 0.008000 
2 U5000005 0.000800 O2001170 02032000 
S OF006550 Oh, Cleeyslone 0.106470 0.024000 
4 0.000350 One L5200 0.045630 0.096000 
5 O20027 55 0.016000 0.163800 0.008000 
6 0.000145 0.064000 O20 70200 0.032000 
g 0.000190 O20101 000 0.004200 0.024000 
8 O-00C0 10 0.004000 0.001800 0.096000 
9 0013300 0.019000 0.163800 O07 2000 
10 0.000700 0.076000 Ono 70200 0.288000 
i OF005510 0.080000 O2252000 0.024000 
Ie 0.000230 O-32Z0000 0.108000 0.096000 
1s 0.009215 0.000800 0.000070 0.008000 
14 0.000485 O00 3200 0.000030 0.032000 
iS eet 5050 OR On5:20:0 ORO 2 730 0.024000 
16 05033950 0.060800 OOO 170 0.096000 
7 O26 7235 0.064000 0.004200 0.008000 
18 0.014065 0.256000 0.001800 0.032000 
Initial State : Z 16 
state Cer e{ 2 C3 C(4 
i OFGG0001 HO -OOGOT0 0.000195 O01 2006 
2 0.000099 0.000990 020038705 oF OZe000 
3 0.000070 0.000190 02007605 On0 55000 
4 0.006930 O20PSE10 0.144495 0.084000 
5 0.000029 0.000800 OF Ont 7 00 Oe OlZ 000 
6 0.002871 OFO7 9200 Oe 272300 6.028000 
7 07000002 0.000050 0.000300 0.036000 
8 0.000198 0.004950 0.005700 0.084000 
9 0.000140 OOOO 950 Oro.) 700 0.108000 
10 O07 013860 0.094050 0.222300 O. 252000 
ll 0.000058 0.004000 OF 018000 O-056000 
2 0.005742 0.396000 0.342000 0.084000 
3 0.000097 0.000040 Oo. 000005 Or oLZ2o00 
14 0.009603 0.003960 O2000095 0.028000 
£5 0.006790 0.000760 0.000195 On O0so000 
16 02672210 0.075240 O-003705 0.084000 
ey] oF O0Z613 OOS 200 000300 O-012000 
iS 0.278487 0.316800 0.005700 0.028000 
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Imteialr State ~~ aes? 


state CG GZ Cres C(4 
iL 0.000035 OFCO0Z200 07002726 0 -OF20010 
Z 0.000005 0.000800 0. 001170 0.048000 
3 0.000095 0.000200 OF00Z730 0.016000 
4 OFOCCOOs 0.000800 OFOOT 1o 0.064000 
5 OseGgs7¢ OF G1 7609 0.267540 0.012000 
6 0.000430 0.078400 0.114660 0.048000 
7 0.000190 0.001000 0.004200 O20Ss6000 
8 0.000010 0.004000 0.001800 0.144000 
9 0.000190 O20 L000 0.004200 0.048000 
VO 0.000010 0.004000 0007600 0.192000 
1k O27 0%5520 0.098000 0.411600 He es5000 
TZ 0.000980 Or 392000 0.176400 0.144000 
1G: OA O07 Ss 0.000800 0.000070 0.012000 
14 0.000485 0003200 OS00GUse 0.048000 
ar O20UIZ 15 0.000800 O- 0008 70 0.016000 
16 0.000485 O,003Z00 0 O0COS0 0.064000 
17 02902070 0.078400 0.006860 O20y700G 
18 0.047530 Oe 31 3600 0.002940 0.048000 
Initial State : 218 
state Ci CiZ Gas C4 
d, 0.000001 0.000010 O- 000095 0.018000 
Z 0.000099 0.000990 O00S 705 0.042000 
3 0.000001 0.000010 ORCC OTS5 0.024000 
4 0.000099 0.000990 02008705 0.056000 
5 0.000098 0.000980 O2079110 0.018000 
6 0.009702 02097020 0.363090 0.042000 
é, OF OU000Z 0.000050 O200G300 0.054000 
8 OLOGO1L9S 0.004950 OZ 0s 700 O21 Z2o00C 
9 02000002 0.000050 DOO SO00 G07 Z000 
10 0.000198 0.004950 O-G05700 0.168000 
ll 0.000196 0.004900 0.029400 0.054000 
ee 0.019404 0.485100 O2556600 O71 26000 
3 o- 000097 0.000040 0.000005 0.018000 
14 0.009603 0.003960 0.000095 0.042000 
iS 0.000097 0.000040 0, 00G005 0.024000 
16 0.009603 0,003960 0.000095 Or, 0S500C0 
17 0.009506 0.003920 0.000490 OGL eO0U 
18 0.941094 0.388080 0.009310 0.042000 


ie 


Gooaness Measurements 


State Combination Goodness Remarks 
Zt) ered val2 val3 value 
af O00 Oreo 0.00 0.00 
2 0.00 0.00 ioe Lee 
3 O00 02350 0.00 Oo) 
4 0.00 0250 io” e250 
5 O00 eo) 0.00 oe 
6 0.00 ee OO 200 2.00 ideal 
7 Oso 0200 0.00 -0.50 
38 250 OOO ie |O O50 
9 Op 50) 50 Ow 0.00 
10 Ges 0 O50 eee) 8) 0 
i) Ono 0 den O O00 a. 50 
12 0250 Oo) 0.0 50 
13 00 0.00 0.00 -1.00 anti-ideal 
14 i010 O00 00 0.00 
iS 00 O50 0.00 =O 50 
16 00 50 0 © 07.50 
ay, 00 00 O00 0.00 
18 00 1.00 i, 00 Oo 
Benefit Matrix 
Seate c(i) ctl Ce C(3) C(4 
ik 02055000 fe 255000 0.340000 0.800000 
2 -0.005000 0.425000 -0.010000 -0.300000 
3 OS 75000 1.180000 0.580000 0.400000 
4 Oph Sao 0 0.270000 0.230000 -0.700000 
5 O20 26000 0.770000 OF 270000 -0.100000 
5 -0.040000 -0.040000 -0.080000 -1.200000 
7 0.160000 So 5000 O27 / 0000 Pea2ego0d 
8 0.100000 0.785000 0.400000 OOOO O0 
9 0.280000 1.540000 0.990000 0.800000 
10 2220000 07 30000 0.640000 -0.300000 
11 0.125000 Ie FSCO 0.680000 Oe sUO00G 
2 0.065000 0.320000 Ons 50000 -0.800000 
13 0.090000 1.600000 1.045000 1.700000 
14 OPO SeCcoo 0.790000 0.695000 0.600000 
aS o- 220000 1.545000 ee aoe Ol 1.300000 
16 Oo. 150000 0.735000 02335000 Om 200 G00 
7 mos 5 000 es 5000 0.975000 O-600000 
13 -0.005000 Oee2e 000 0.625000 -0.3000C00 


Decision Choices 


mr rRrRr Pp 
PWM ODO M~IDUNDWhMHOr 


Mr P 
Oo ~I OV 


set arbitary v(18) 


maxincome per period : 


Choice Policy 
C(k) 


MNWNNM PUNE prnmnr bmn LD 


tOro 
2.220446049E-15 
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APPENDIX D 
UNIVERSITY SCHEDULE EXAMPLE 
KRRERERKEKKRKKRKRKRKRKRKRRKRRKRKRKRRKAKRKRKRKRKRKA 
xR aX 
<5 ee) Sc scmememinteraction ** 
<> ax 


KAKRKKAAKAKKKARKKRKKKKRAKKKRKKKRRARKRERRR 


Formulate problem and prepare estimation probabilities 


Problem description 
P : Importance of problems to be solved 


>: Beene effectiveness in problem-solving 

E : Potential energy of participants 

pl=0 No important problem regarding teaching load, class 
Size, and thesis advising 

Bee Nedenate tdcueevesnOntage, sarge adjunct faculty, big 
eicdss SiZepe i nsurticilene thesis advisors, shortage of 
required infrastructural facilities 

p3=1 Acute shortage of faculty, immense class size, heavy 
thesis load, and conflicts in class scheduling 

S1=0 Very poor quality teaching and research faculty, poor 
administration, inability to attract new ‘faculty, 
Uneewerolled student admission 

ezoo Modeudrely serrective faculty, reasonable student - 
faculty ratio, nominally effective administration 

53=1 Excellent area LcacminGeducmieseatel Laculiy pest 
SelCcCuMmeaeraglcy Hatton eLrective administration and 
leadership,ample supporting infrastructural facilities 

El=0 Faculty uninterested in teaching, insufficient time 
devoted to problem solving, low motivation 

E2=1 High motivation, good productivity and commitment, 


dedicated teaching faculty, administrators 


Alternative choices 


c(1) 
C(2) 
C(3) 
C(4) 
C(5) 


Hire new faculty 

Administer existing faculty better 
Regulate student admission 

Tailor class size to faculty availability 
Add infrastructural facilities 


EF 





Choice™  On00- aE Onee 1.007 GROChOTs? 
i 0.94 9 0.74 0.05 “O20 seorGe 
1 0.05 ~<0.25 "80.30 \0-20" Gace 
it OO Cleo 0.65 0.10 > Ome 
2 OnoF 0.59 0.05 0.05 ~Gize 
Z 0.02 0.40 0.45 0.94 Q.50 
Z O20 O20 05.50 O50 1 O38 
5 O26 Q.60 On07 0.40 0205 
3 0.03° 90.38 0.40 “90255 PORE 
3 OneL G02 0.359 O05 O65 
= O295 OLS O01 On O02 
4 0.04 0.84 (0.09) 0.26.) Ges 
OO O.04 02.50 O-0s 0.45 
5 0.390 0.24 O7Os 0.84 C213 
5 0.05 0.75 0240 -Q212> WeGiee 
5 0.05 07.08 O22 0.04 030 
II. Execution 
Select Menu Option 
. ExecGCM (Execute GCM Best an, 
2. EXGCEM1E( EX@Cution cop 


Enter # of scale points for each factor 


Paectcr i; 3 
facror 2: S 
PaAGecOL our: 2 
goahead : Press any key, correction : "%"' 


Get Number of Choices for each State Z(1i) 


Seece ya 2 Or Choices 
Poe - 
Zoe + 
oa + 
4 ? - 
Brae 5 
G2 5 
a2 5 
S72 5 
See 5 
VOR? 5 
i 5 
Pe ee 5 
Tear + 
14 ? 4 
lo ae = 
nei c = 
iene? 5 
Lee 5 
goahead : Press any key, correction : "%" 
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OOO 


OOO 


i 


OoO0c @eCge 


OOO 


.O0 


00 


307 
oo 


OU 
.40 


nee 
08 


Ue 


08 
woe 


.08 
soe 


04 
- 26 


oe 
oo 


Get Estimation 


fPaaetor! ) 

Bieial scate 

Terminal State 
probl prob2 


imaistial State 
Terminal State 
probl prob2 


imtetal State 
Perminal State 
probl proepZ 


Probabalities 


f(1) = 


prob3 z 
aly) a 


prob3 ? 
f(1l) = 
prob3 a 


Choice 


0705 0.01 
Choice 


O25, 0.0) 
Choice 


Cro OeU soe 


eu) 


es) 


cq) 


Ca2oisplay Input Data =) 


o:00 


Oe 


0 


Oe 


i 0.94 0.74 nos 


i O05 
it O201 


goahead 


OvZze 
O.eH 


: Press any key, correction : 


fy 


KAARKKKAKKKKKKKRKKAKKKKKKKKKRKKAKAKKKKK 
AK AX 


xx Step II : Generate Matrices ** 
xx KX 


KRARKKAKKKKKKRKRKKKRKAKKRKKRKRKKRARAKKKKK 


Transition Matyi 


Tnhitial State = ez! 


state C(¢l CZ CLS C(4 
1 0.062980 0.029100 0.349440 0.600305 
2 02031020 0.019400 0.034560 O7074135 
3 0.503840 0.547080 0.480480 0.219830 
4 0.248160 0.364720 0.047520 0.027179 
5 0.062980 0.005820 0.043680 0, 025365 
5 0. 0S020 0.003880 0.004320 O 200s b35 
7 0.003350 0.000600 0.020920 OOS 
8 0. 00L650 0.000400 0.001080 0.003124 
9 0.026800 0 .O25F 280 0, OLsOns 0.009256 
LO O20 12200 0.067520 0.001485 0.001144 
el 0.003350 0.000726 0. 001865 0.001068 
12 0.001650 0.000080 0 S000 ls. 0,000 s2 
is 0.000670 0 OO0S06G 0.003640 0.006319 
14 0.000330 0: 00020G 0.000360 OO. 000721 
15 O.00s360 0.005640 0. G0s005 0.002314 
16 0.002640 On 035760 0.000495 0.000286 
Le 0.060670 0.000060 0.000455 0.000267 
18 0,00C03S0 0.000040 0.000045 0. 000803s 
iidtial Stave 42 2 
state CCl CiZ Cs C(4 
1 02007520 0.007275 0.030726 0.026980 
Z 0.080480 0.041225 O23 58250 0.647520 
3 0.060160 0.136770 0.042240 0.009880 
4 0.691840 O27 750350 0.485760 O. 250020 
5 0.007520 0.001455 0.003840 0.001140 
5 0.086480 0.008245 0.044160 O2027260 
0 0.000400 0.000150 0.000960 OF O06 
8 0.004600 0.000850 0.011040 0.027264 
9 003200 0 ,002820 0. 0Gn 220 0.000416 
10 0.026600 0.015980 O.-OLSis0 0.009984 
al 0.000400 0. 000020 O 000826 0.000048 
We 0.004600 0, 000i7 0 0.001330 0 sOGISZ 
13 0.000080 0.006075 0.000320 0.000284 
14 0.000920 0.000425 0.003680 0.006816 
ae 0.000640 O.0G1410 0.000440 0.000104 
16 07007560 0.007990 0.005060 0.002496 
Ly 0.000080 OFOG0CTS 0.000040 0.000012 
13 0.000920 0.000085 0.000460 0 ;000Z386 
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imielalesrate < Z 


Ca C(2 ees C(4 

1 0.031490 0.116400 0.043680 ol oglo 
Z Gr Oieo 5180 0-07 7600 0.004320 One Z090 
3 Oe220450 ORz2oldgG 0.262080 0.448115 
4 O27 ess) 0 0.194000 02025920 O05 53e5 
5 O37 O50 Om 746000 0.567840 OFse0475 
6 02186120 0.116400 Jee Sele 0.047025 
a OPoONe 7S 0.002400 O27 001365 O200071Z2 
8 02000825 0.001600 O,O0O1T35 0.000088 
9 O7OPL? 25 0.006000 O006190 0.018868 
10 Oe05775 0.004000 O200C810 OO Z3 52 
ae O70zZ0100 On 008000 0.017745 Oo L600 20 
eZ 0.009900 0.002400 ono ol 755 0.001980 
is O2000s8 35 OFOOLZ00 0.000455 Ono 7s 
14 O-OU01TE 5 0.000800 920900045 ORO WOO7Z 
PS 0.002345 0.003000 O20027 30 O2004 717 
O20 1155 2002000 o000Z270 IOUS S3 
0.004020 VOC LeOO O2005915 0.004005 

ro 0.001980 0.001200 O-000565 0.000495 

Initial State :2Z 4 
state Gil C(2 EC3 C(4 

1 OAs0s 750 Ome2 oe 0.003840 02000760 
Z 0.043240 0.164900 0.044160 0.018240 
S 0201275520 O7072750 0.023040 0.020140 
4 O23 02660 @412250 0.264960 0.483360 
5 O25 20 0.043650 0.049920 Ono n7 LOO 
6 O52 8500 0.247350 0.574080 0.410400 
2 0.000200 0.000600 OeeoatZ20 O2000032Z 
8 02002300 0.003400 Dao sco 0.000768 
9 0.001400 07001500 0007 20 0.000848 
10 Oo 6 100 Qe006500 OeOVSZo0 OR GZ20352 
11 0.002400 0.000900 0.001560 o-0007 20 
2 0.027600 07005100 0.017940 5007260 
Ss 0.000040 I090300 0.000040 0.000008 
14 0.000460 02001700 0.000460 O2G00L>972 
ES 02000726) OF O07 50 0.000240 O2000Z12 
16 OmOCsz220 0.004250 0.002760 0.005088 
17 0.000480 0.000450 O2900520 OO. 800LE0 
1S oRoes520 0002550 O00 5960 0.004320 


Initia: State e .2 


Eel CiZ e.3 C(4 C 
iu 0.006298 0.005820 07006736 0.008455 0.091080 
Z 02003 102 0.003880 0.000864 0.001045 0.007920m 
S 07125960 0.058200 0.008736 0.016910 0.356040 
4 0.062040 0.038800 0.000864 0.002090 0.030960 
S On49 7542 0.517980 Or e>oolZs 0.820135 0.380880 
6 0.245056 ess 552) 0.084672 On tO Ses 0.033120 
fi) Ol OOS ES 0.000120 OZ O002Z7.s 0.000356 0.005060 
8 0.900165 0.000080 0.000027 0.000044 0.000440 
Q 0.006700 02001200 02000275 0.000712 0.019780 
10 07008300 0.000800 O2000027 0.000088 0.00172¢@ 
ital 0.026465 0.010580 0.026754 0.034532 0.021168 
12 O70 lS O25 On007 720 0.002646 0.004268 0.001840 
i2 0.000067 0.000060 0.000091 0.000089 0.005060 
14 g- 000033 0.000040 OLOC00es O[0000 Ti 0.000440 
is 0.001340 0.000600 0.000091 0.000178 0.019738 
16 0.000660 0.000400 0.000009 0.000022 0.001728 
17 O00 293 0.005340 0.008918 0.008633 0.021 i6@ 
18 0.002607 0.003560 0.000882 0 00 h0Gy 0.001840 
Initial State =.Z 6 
state are GZ ergs C(4 CS 
1 070007 52 On 001455 0.000768 0.000380 0.02970 
Z 0.008648 0.008245 O200eEsZ 0.009120 0.069300 
S 0.015040 02014550 0.000768 0.000760 0.116100 
4 0.172960 0.082450 0.008832 0.018240 0.270900 
5 0.059408 0.129495 0.075264 0.036860 0.124206 
6 0.685132 027323805 0.865536 0.884640 0.289800 
7 0.000040 O-000039 0.000024 0.000016 0.001650 
8 0.000460 0.000170 0.000276 0.000384 0.003850 
9 0.000800 0.000300 0.000024 05000032 0.006450 
10 0.009200 0.001700 0.000276 0.000768 0.015056 
a) 0.003160 0.002670 02002352 0. COS S72 0.006900 
eZ 0.036340 O20 130 0.027048 0.037248 0.016100 
es O,000008 OVOD00LS 0.000008 0.000004 0 .0OTéESG¢ 
14 0.000092 027096085 0.000092 0.000096 0.003858 
15 OU O0CmE0 OOOO 50 0.000008 0.Q00008 0.006450 
16 0.001840 0.000850 0.000092 O00 Ole 0.015050 
Ay 0.000632 OPOgrss5 0.000784 0.000388 0.006900 
13 0.007268 0.007565 0.009016 0.009312 0.016100 


Tereral State : Z 7 


state Cel G2 Ets C(4 Cc 
i 0.049580 G07 00 0.218400 0.094785 Ose 547 2 
Z 0.024420 O20) fe0e G02 1000 O2er1/715 AO ro ls 
2 0.396640 Ors 52760 02500300 On 247 1,0 0.026496 
4 02195360 0.221840 02029700 0.004290 0.002304 
5 0.049580 0.003540 O2027300 0.004005 On0GessZ 
6 0.024420 07002560 G2oOZz 7/00 0.000495 0.000768 
7 Heeler 50 02612000 0.36220 02530796 0.579600 
8 Os00SZ250 0.008000 Oe lsece 0.065604 0.050400 
9 Ons 2000 Oe 25000 0.190190 0.194376 O70eZa00 
a 0.066000 OF 150400 0138810 0.024024 O- oozed 
il O20le750 0.002400 OnO17 290 0.022423 0.027600 
a 0.008250 0.001600 O2601710 O2002772 0.002400 
i 0.000570 H2C0O0300 2007250 0.006319 O2007 726 
14 G2000330 0.000200 Ue 0087 20 O2C0G761 GO, COE? Z 
iS O00 5360 0.005640 O7.010010 O20023 14 0.001104 
16 0.002640 0.003760 0.000930 0.000285 0.000096 
a7 0.000670 0.000060 OFA OO LOSI, 0.000267 0.000368 
LS UFOU0S30 0.000040 0.000090 O-000C33 O20 00s 2 


Initial State :Z 8 


state GG eZ GC3 C(4 Cs 
il 7005920 0.004425 HTC 200 0.004260 0.060480 
Z 068080 H2025075 O2202800 0.102240 O2142120 
5 nO47500 02055190 0.026400 O2C01560 0.008640 
4 .544640 0.471410 0.303600 0.037440 O29Z01660 
5 005920 0.000885 0.002400 0.000180 0.002880 
5 .068080 OFo0s5015 0.027600 0.004320 O2006720 
; 002000 005000 Uae 60 7023556 OU. 1S9C00 
8 50231000 © 701700 0.139840 0.572544 0.441000 
9 .016000 0.056400 G7015720 On0Gs7 3.6 C202 7000 
10 . 184000 O23 19600 C19 2250 0.209664 0.063000 
bi 002000 0.000600 G2 001520 UAeCoL vs 0.009000 
2 7023000 0.003400 0.017480 0.024192 0.021000 
L3 000080 GeeCeo7sS 0.000640 0.000284 © .002520 
14 000920 C0804 75 2007560 0.006816 O2005830 
Jus 000640 O200L410 0.000880 0.000104 O22 000366 
16 fOu7 200 0.007990 Or OVO 0 0.002436 0.000840 
ing 000080 GFe00015 0.000080 0.000012 G7 OSGi 70 
io .000920 0.000085 0.000920 0.000288 0.000280 


| 


Initial State 22 





state Cet Cre Ce C(4 
il 0.024790 0.070800 0.027300 002670 0.0287 
2 O.027Z TO 0.047206 0.002700 000330 0.002496 
3 Oel73536 0.177000 0.163800 09/1017 55 0.125856 
4 0.085470 0.118000 0.016200 .008745 0.010944 
5 0.297480 0.106200 0.354900 .C60075 0.066240 
6 0.146520 0.070800 0.035100 OC? 225 0.005760 
7 0.008375 0.048000 Os01 72910 014952 0.089700 
8 00047125 0.032000 Ono ee .001848 0.007800 
9 0.058625 OI Z20000 O07 103720 . 396228 0.393300 
10 0.028875 0.080000 0.010260 .048972 0.034200 
al 0.100500 G207 2000 O.. 224770 . 336420 0.207000 
eZ 0.049500 0.048000 0.022250 041580 0.018003 
13 O7,O0G 245 0.001200 0.000910 .000178 0.001196 
14 0.000165 0.000800 0.000030 ~000022 0.000lTG2 
i 0.002345 O-odso00 0.005460 sO 0dg iy 0.005244 
16 OOO 55 0.002000 0.000540 LOUG@ses 0.000456 
alae 0.004020 OF 001800 OVOLESs0 .004005 0.002760 
cS Oe C0 hese O2O0TZ00 OC OCirir 7 @ ~.000495 0.000240 
Initial State : Z 10 
Ciel eZ C3 C(4 E 
i 0.002960 Ool77 00 C0022 06 OVO08356 0.001500 
2 0.024040 O. 100300 0.027600 0.001650 0.001000 
3 020720720 0.044250 O20 14400 0.026800 0.028200 
4 02248260 0.250750 0.165600 0.2013 206 0.018800 
5 Or 085520 G@s0'26550 07631200 6 003456 0.000300 
6 0.408480 0.150450 Os se500 O-0Ot6s 0 0.000203 
7 OCOLOCO 0.012000 0. .0075 20 0.020100 Q0.01350¢ 
8 O Ciesou 0.068000 0.017480 0.009900 0.009000 
9 0.007000 0.030000 0.009120 0.160800 0.253660 
© O..050500 O17 0000 0.104880 0.073200 0.169200 
ale 0.012000 0.018000 0.613760 0'.020100 0.002700 
eZ 0.138000 0.102000 Ome2 7240 0.009900 0.001800 
13 0.000040 0.006300 0.000080 0.043550 0.015000 
14 0.000460 0.001700 0.000920 OTOZ1T450 0.010000 
LS 0.000280 O20007 50 0.000480 0.348400 0.282000 
16 0.003220 OV004250 0.005520 0.171600 0.188000 
L7 0.000480 0.000450 Q.001040 O03 550 0.003000 
18 0.005520 0002550 0.011960 0.021456 0.002000 


Mateial State =: Z il] 


state eel CZ Crs C(4 C 
1 0.003640 C006319 0.000400 0.000375 0.000320 
Z 0.000360 Ceeeo7 ei 0.004600 Or00Z21 25 O 803660 
3 0.005005 0.002314 0.003200 Vee Oa8 0.000440 
+ 0.000495 0.000286 OFOSes00 Ons sIo0 0.005060 
5 0.000455 OTGC0Zo7 0.000400 0.000075 0.000040 
6 0.000045 OBeegss 0.094600 0.000425 0.000460 
i 0.145600 On O05e87 1 0.002400 O00 53/2 Q.012800 
8 0.014400 O.Cn7 029 0.027600 Ono oiZs 0.147200 
g 0.200200 0.020826 2019200 0.063450 0.017600 
M8. 0.019800 0.002574 0.220800 Oe 2250 0.202400 
ey 0.018200 0.002403 0.002400 0.000675 0.001600 
2 0.001800 0.000297 2027000 We O0S8.25 OFGrscop 
3 0.214760 05556710 Oro 5200 CRs); 50 0.018880 
14 0.021240 ORO 02 90 0.059800 OeeZ ZOU O21 2020 
iS e275 295 On e250 0.041600 O07 0500 0. UZ 5960 
16 OROZ9205 O022740 0.478400 Os Sele ks ele, 0.298540 
17 Gr0zecds OBU2Z4020 0.005200 0.000750 0.002360 
18 BEURZ655 Oe e02970 057500 0.004250 0.027140 


Ittial State :- Z 12 


Sree Cul eZ Cs C4 c 
i 0.000284 O200Ne7 > 0.006000 0.000455 OP COOL7s 
2 0.006816 0.000825 0.004000 0.000045 0.000022 
3 0.000104 OO 25 O01 35000 OE 002Z730 0.004717 
4 0.002496 O20037 75 0.010000 0.000270 CO. V00583 
5 O09R01 2 Ceo oe 0.009000 We COs9l> 0.004005 
6 GOL OC0ZSs 0.009900 0.006000 W20OUSS> 0.000495 
y 02002556 OO LOUS 0 0.054000 OO Z00 QUOTE U 
8 0.061344 0.004950 Oe 0S6000 OZ OOe00 0.000198 
9 OF OC 0936 CROZ0eo0 0.135000 Or LOsZ00 0.042453 
10 0.022464 0.034650 0.090000 0.010800 0.005247 
ie 0.000108 0.120600 0.081000 Wezsco00 0.036045 
12 OOO 2592 0.059400 0.054000 0.023400 0.004455 
2 VE 9Z9560 Ore 75 0.060000 0.026845 0.016020 
14 0.613440 OmOma 12> 0.040000 0.002655 O00 1280 
i 0.009360 ORs a2. 0.150000 Cl aewkely ae: 0.424530 
iG 0.224640 ORoy S07 © 0.100000 Oreo S230 0.052470 
7 0.001080 OnZ2ols00 0.090000 0.348985 0.360450 
18 Pea 920 Cees 700 0.060000 0.034515 0.044550 


Ingteal State = Zais 


state Cx GZ Cia C(4 
v 0.003350 0.001500 0.003640 0.006319 
2 0.001650 OF OOOO 0 0.000360 Oo. OC07er 
S 0.026800 0.028200 O.G0Scos 0.002314 
4 O- 015200 0.018800 0.000435 0.000286 
5 020023350 0.000300 0.000455 ‘euclelevAcw, 
6 O.001650 0.000200 oO, cdoe4s 0.000033 
z 0.020100 Oo S00 0.145600 O”.056671 
3 0.00933900 0.003000 0.014400 0.007023 
g 0.160800 O2255c00 O02 200200 O20 Z0526 
10 0.079200 Ophea I200 0.019800 0.002574 
ie 0.020100 0.002700 0.018200 0.002403 
eZ 0.003300 SCO lSs0o 0.001800 0.000237 
ies 05043550 7015000 0.214760 O2565719 
14 0.021450 0.010000 0.021240 0.070290 
iS 0.348400 0.282000 0.295295 0.208260 
16 0.171600 0.188000 0.029205 0.025740 
7 OP0a35e0 0.003000 0.026845 0.024030 
13 0.021450 02002000 O 3002655 0.002370 


Initial State : Z 14 


Stace Cr Gi2 es, C(4 
1 0.000400 G2000375 O-00es20 0.000284 
2 0.004600 OR OOZ2 5 0.003680 0.006816 
3 0-003 200 0.007050 0.000440 0.000104 
4 0.935500 OR Osc. 0 0.005060 0.002496 
5 0.000400 0.000075 0.000040 0.000012 
6 0.004600 0.000425 0.000460 0.000288 
7 0.002400 203675 0.012800 0.002556 
8 07027600 O27 One 25 0.147200 0.061344 
2 G20L3Z00 0.063450 0.017600 O-O0e236 
10 0.220800 03352530 0.202400 0.022464 
Tt 0.002400 0.000675 0.001600 0.000108 
IZ 07027600 0-7 002825 0.018400 OMOUZ 392 
bie: 0005200 Ones 7 50 0.013880 OZ 560 
14 G0s2800 O70 21250 O Zee 0 0.613440 
i 0.041500 0.070500 Ono Ze ci G-Ce 2368 
16 0.478400 0 392500 0.298540 0.224640 
Ly C2 00ac00 0.000750 0.002360 0.001080 
Le Gs0s57800 0.004250 0.027140 OV025920 


ititeral State « Z 15 


state Ci l C(2 aes C(4 
1 0.001675 0.006000 0.000455 pmCO017S 
Z 000625 0.004000 0.000045 OReCOo0 ZZ 
5 OO) 1725 Ono S000 OH -002730 0.004717 
4 Oo 005775 0.010000 o7000270 0.000583 
& O10 20100 0.009000 OROOSS15 OA OO4Z00S 
6 0.009900 0.006000 O 000585 0.000495 
7 FO 10050 0.054000 07018200 OOO L602 
8 0.004950 O- 635000 Oo, 001800 0.000198 
9 02070350 O72 5000 0.109200 0.042453 
io meses 50 0.090000 0.010800 OW. 005247 
a 0.120600 02082000 0.236600 0.036045 
eZ 0.659400 0.054000 0.023400 0.004455 
ye OnOZ1 775 0.060000 0.026845 OF elo020 
14 O2010725 0.040000 0.002655 0.001980 
Ies Oe52425 0.150000 c161070 0.424530 
16 We07 5075 0.190000 OF 0159350 ee 52270 
iL, 0.261300 0.020000 0.348985 0.360450 
18 23700 0.060000 o.0S4505 0.044550 
Initial State : Z 16 
state CCl CZ Cts C(4 
1 OOOO ZU0 O7e015e6 0.000040 0.000008 
Z 02002500 0.008500 0.000460 0.000192 
3 02001400 O-003750 0.000240 Or GOOZ12 
4 Oe 100 ee 2250 0.002760 O,005085 
5 0.002400 O2602250 07000520 0.000180 
6 0.027600 Oh? 50 0005980 oO 004320 
a 0.001200 2013500 0.001600 On O00 72 
8 O-Orsa00 0076500 0.018400 O,0017 26 
9 0.008400 Ores 750 0.009600 O,00T sos 
6 0.095600 Cruel Z 50 0.110400 0.045792 
eal 0.014400 O2020250 0.020800 O- 001670 
ee OF 165600 Omen 7 50 02239200 0.038880 
es 0.002600 015000 0.002360 OOOO 720 
14 0.029900 02025000 0202/7140 O01] 250 
a5 013200 07037500 0.014160 0.019080 
16 0.209300 O21 2500 0.162840 0.457920 
lw Ores) Z200 G2027500 0.020680 O.016200 
13 0.358800 O22 7500 Ore ooo 0.388300 


Tnittial State = 217 





state Ca erZ Cis C(4 G 
1 0.000335 0.000300 0.000091 0.000089 0.008096 
2 0.000165 0.000200 0.000009 0. 0evone: 0.000704 
3 0.006700 0.003000 0.000091 O-00017s6 0.031648 
4 O-002300 0.002000 0.000009 OP 000GzZZ 0.002752 
5 0.026465 0202600 0.008912 0.008633 0.0338S8 
6 O-0L34035 One, Soo Ve000esSZ OOO Ley 0.002944 
7 07002010 He 002700 0.003640 O-O00ser 0.040480 
8 0.000990 OZOO1LSoO0 VRVOOGE” 0.000099 0.003528 
9 0.040200 02027000 0.003640 O.00160Z2 0.158240 
Ee 0.019800 0.018000 0.000360 O2O00CLIs 0.013769 
im 02758790 0.240300 O-350720 0.077697 0.169280 
12 O50 32.0 Ore 0200 O20s5ze0 0.009603 0.014720 
ies O84 s 55 0.003000 0.005369 O00s010 0.052624 
14 0.002145 Og Z000 OQ .0CCsen 0.000990 0.004576 
LS Ov0e7 100 0-0S50000 0.005369 0.016020 0.205734 
16 0.042900 0.020000 O2000531 0.001980 0.017888 
by 0.344045 0.267000 0.526162 02776970 0.220064 
18 0.169455 O71 OOo OeOSZ0e4 0.096030 0.019186 
Initial State : Z 18 
State CCl Giz ECs C(4 Ce 
il 0.000040 G2 000075 0.000008 0.000004 0.002640 
2 0.000460 0.000425 0.000092 0.000096 0.006160 
3 0.000800 OAOO0 7 50 0.000008 02090005 0.010624 
4 0.009200 O2004250 0.000092 0.000192 0.024080 
5 OOS 160 0.006675 0.000784 0.000388 0.011040 
6 0.036240 Ore 7225 0.009016 0.009812 0.025768 
7 0.G00240 O200067 5 OZ0e02Z20 0.000036 0.013206 
8 0.002760 Oe0se25 0.003680 0.000864 0.030800 
9 0.004800 O00 6750 OOO tEe 20 02000072 0.051606 
10 0-055200 0s 6250 0.003680 O20017 25 0.120400 
ileal: 0.018960 pe0c0075 0.031360 0.003492 0.058208 
12 0.218040 0.340425 0.360640 O,062506 0.128608 
6 0.000520 020007 50 0.000472 0.000360 QO. O07 es 
14 0.005980 0.004250 0.005428 0.008640 0.040040 
15 0.010400 9007500 0.000472 02080720 0.067080 
15 0.119600 0.042500 0.005428 02077280 0.156529 
Ly 0.041060 0.066750 0.046256 0.034920 0.071 7ae 
i 0.472420 Ore 7e250 0.531944 0.838080 0.167440 


State Compination Goodness Remarks 
Zo vail val2 val3 value 
iE O77 GO 02.00 O00 le ele 
Z OOo O00 00 iO © 
3 O00 On o0 cco O25 
4 ORG O50 OO 12350 
> Or GO TOD 0.00 eee) 
6 0.00 ee) O U0 2a) ideal 
y 0-50 0200 0.00 -0.50 
3 Oo 0200 00 O50 
S 0250 0. 50 0.00 0200 
10 0.50 O50 60 0 
leak OF 50 e200 O00 Oe 50 
eZ 0 OG ae o eo) 
i3 1.00 O00 0.00 -1.00 anti-ideal 
14 i! 200 0.00 1.00 O00 
ies ieee O50 0.00 -0.50 
6 00 Or50 TOI0 O50 
7, LOO LO O00 C.00 
le e000 eo OO Leo 
Benefit Mates 
State Z(i) C(1) Ge?) ey C(4) 
iL O77 35000 0.860000 0.390000 0.240000 
2 O2Sc5000 0-2 10000 0.220000 O7 690009 
S O..570000 0.430000 0.365000 0.295000 
4 oe loco ue -0.120C00 0.195000 0.145000 
5 GO. les000 023520000 O20 S0000 0.060000 
5 -0.225000 -0.230000 -0.120000 -0.090000 
7 ieee eo nl Pel U0RG OF 705000 0.340009 
8 O27 55000 0.620000 Oss SUC 0. LI0G00 
9 0.970000 0.740000 0.680000 0395000 
10 Uo COCUO Osco e 0.500060 -0.970000 
gil -0.875000 =) £7 SOOO C2 LZ20000 OalL0S000 
eZ =)).325000 =) Losec My A701 08) -1.400000 
es 1.030000 leas SOO O562 5000 Oe 25060 
14 ee oZ0000 GO -o0Sc00 0.455000 OA 75000 
WS VE euUSc00 Oeizol00 0.600000 0.360000 
6 Ges 55000 Orly Seed G3430000 One SOOO 
7 0.420000 VE 6LS5000 0.255000 0.145000 
i8 0.010000 0.065000 0. 15000 -0.0059000 


Goodness Measurements 
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=i) 
=) 

0 
=O) 


=) 
Sal 


Coo 


320000 
. 700000 
225000 
-085000 
. 280000 
-645000 
.045000 
-620000 


sos 5000 
345000 


Decision Choices 


State Choice Polley 
Ze) C(k) 
i t 
2 i 
S 1 
t 3 
5 1 
6 4 
7 1 
8 L 
9 1M 
10 4 
Jen 4 
Le Z 
rs I. 
14 2 
i 1 
16 S 
17 I 
16 4 


set arbitary vilS) “toqe 
maxincome per period : 5.412337245E-16 


S$ 


10. 


rl 
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